00000001:02000400:2.0F:1789049818.922070:0:3319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789049827.247165:0:3522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789049828.180512:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1351 MB/s 00000001:01000000:2.0:1789049828.430213:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1627 MB/s 00000001:01000000:2.0:1789049828.680069:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10147 MB/s 00000020:02000000:2.0:1789049829.498857:0:3613:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g3ed9deb 00000400:02000000:1.0F:1789049830.486448:0:3628:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.142@tcp [8/256/0/180] 00008000:02000000:3.0F:1789049834.531817:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789049895.781245:0:5745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789049909.207810:0:6495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049909.207817:0:6495:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789049909.207818:0:6495:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789049909.208033:0:6495:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bd173719 00000080:02000400:3.0:1789049909.208045:0:6495:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789049909.213663:0:6495:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789049909.213676:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789049909.213703:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a7cbebb3) 00000020:00000080:3.0:1789049909.213721:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789049909.284307:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789049909.284418:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1789049909.317142:0:6495:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789049909.317367:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789049909.317375:0:6495:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789049909.317386:0:6495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df56e97 00000020:01000004:2.0:1789049909.317404:0:6495:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789049909.317409:0:6495:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789049909.317414:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd173719 from MGS 00000020:01000004:2.0:1789049909.317418:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789049909.317440:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000029048843) 00000020:00000080:2.0:1789049909.317453:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789049909.318776:0:6495:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd173719 from MGS, refs=2 00080000:01000000:2.0:1789049909.318789:0:6495:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789049909.318800:0:6495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df56ea5 00000100:00100000:2.0:1789049909.318962:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789049909.319125:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789049909.319131:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789049909.320346:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789049909.320357:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789049909.321735:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049909.321922:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789049909.321927:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789049909.322917:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789049909.322924:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789049909.323497:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789049909.323504:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789049909.324878:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049909.324883:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049909.324884:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049909.325739:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049909.325743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049909.325745:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049909.329633:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789049909.334622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789049909.579364:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2747 MB/s 00000001:01000000:3.0:1789049909.832114:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2640 MB/s 00000001:01000000:0.0:1789049910.094554:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 615 MB/s 00000001:01000000:0.0:1789049910.344185:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 611 MB/s 00080000:10000000:0.0:1789049910.354594:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789049910.376723:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1789049910.377140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789049910.378075:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789049910.379889:0:6495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789049910.380134:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789049910.380322:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789049910.380346:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789049910.381097:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.381267:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789049910.381274:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789049910.404305:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789049910.404334:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789049910.405219:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789049910.405228:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789049910.405814:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789049910.405836:0:6495:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.142@tcp' 00000020:01000004:2.0:1789049910.405838:0:6495:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789049910.405881:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.142@tcp (typ=mgc) 00000020:00000080:2.0:1789049910.405892:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.142@tcp (000000007186df58) 00000020:00000080:2.0:1789049910.405907:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789049910.406031:0:6495:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ec797856@MGC192.168.203.142@tcp: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789049910.406200:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.142@tcp-0 is initialized 00000040:01000000:2.0:1789049910.406207:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789049910.407815:0:6514:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789049910.408398:0:6515:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789049910.408467:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.142@tcp (uuid b8839590-fd25-4606-bad2-917c49937107) 00000020:00000080:1.0:1789049910.408497:0:6495:0:(genops.c:1384:class_connect()) connect: client b8839590-fd25-4606-bad2-917c49937107, cookie 0x3b8ec5973df56eb3 00000100:00080000:1.0:1789049910.408509:0:6495:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049910.408519:0:6495:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import 00000000ec797856 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789049910.408558:0:6495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d5b578af x1875954714542208/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789049910.408584:0:6495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b8839590-fd25-4606-bad2-917c49937107->MGS 00000020:01000004:1.0:1789049910.408601:0:6495:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789049910.408620:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789049910.408646:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d41c2e06) 00000020:00000080:1.0:1789049910.408656:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789049910.411127:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5b578af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714542208:0@lo:250: 00000100:00100000:0.0:1789049910.411237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.414846:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542208 00000100:00100000:2.0:1789049910.414863:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542208 00000100:00100000:2.0:1789049910.414900:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049910.414907:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044f6b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875954714542208:12345-0@lo:250: 00010000:00080000:2.0:1789049910.414934:0:6510:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b8839590-fd25-4606-bad2-917c49937107@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1789049910.415008:0:6510:0:(genops.c:1384:class_connect()) connect: client b8839590-fd25-4606-bad2-917c49937107, cookie 0x3b8ec5973df56ec1 00000100:00080000:2.0:1789049910.415172:0:6510:0:(import.c:65:import_set_state_nolock()) 0000000019cb8ab7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049910.415284:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044f6b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+5:3643:x1875954714542208:12345-0@lo:250: Request processed in 376us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.415293:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049910.415337:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789049910.415348:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.142@tcp: connect to target with instance 0 00000100:00080000:2.0:1789049910.415356:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789049910.415360:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789049910.415363:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ec797856 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789049910.415366:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789049910.415373:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789049910.415378:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5b578af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714542208:0@lo:250: 00000100:00100000:1.0:1789049910.422376:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.422776:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789049910.422784:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789049910.428432:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789049910.428443:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789049910.428881:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789049910.428887:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789049910.429632:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.429817:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789049910.429821:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789049910.433897:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789049910.433910:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789049910.530765:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049910.531043:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789049910.531050:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789049910.539899:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789049910.539914:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789049910.543982:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.544204:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789049910.544211:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789049910.550410:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789049910.550422:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789049910.551176:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.551365:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789049910.551370:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789049910.552659:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789049910.552669:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789049910.553265:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049910.553648:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789049910.553654:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789049910.561286:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049910.561304:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789049910.577372:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049910.577601:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789049910.577608:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789049910.579368:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789049910.579380:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789049910.584744:0:6495:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789049910.584759:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789049910.586529:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789049910.586562:0:6495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789049910.586568:0:6495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789049910.586667:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789049910.586701:0:6495:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789049910.586705:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789049910.586707:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789049910.586708:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049910.586709:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049910.586710:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049910.586711:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049910.586712:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049910.586714:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789049910.586715:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049910.586716:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049910.586717:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049910.586719:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049910.586721:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789049910.586723:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049910.586724:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789049910.586725:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049910.586726:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049910.586727:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049910.586728:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049910.586729:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049910.586729:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789049910.586730:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049910.586731:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049910.586732:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049910.586733:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049910.586778:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789049910.586796:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542336:0@lo:253: 00000100:00100000:2.0:1789049910.586872:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.586920:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000003201083b going to sleep for 11 seconds 00000100:00100000:0.0:1789049910.587025:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542336 00000100:00100000:0.0:1789049910.587034:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542336 00000100:00100000:0.0:1789049910.587081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049910.587090:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc18f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+5:6495:x1875954714542336:12345-0@lo:253: 20000000:01000000:0.0:1789049910.587250:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789049910.587253:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789049910.587750:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789049910.587785:0:6513:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789049910.590348:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049910.593426:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789049910.593858:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789049910.593863:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789049910.593870:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789049910.593872:0:6513:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789049910.593886:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789049910.594286:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049910.594452:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789049910.594469:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789049910.594489:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789049910.594507:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789049910.594543:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789049910.594603:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789049910.594611:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789049910.594625:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789049910.594631:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789049910.594643:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789049910.594648:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789049910.594662:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789049910.594677:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789049910.594718:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789049910.594724:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789049910.594732:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049910.594829:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789049910.594840:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789049910.594854:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789049910.594870:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789049910.594885:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789049910.594894:0:6513:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789049910.594919:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789049910.594926:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789049910.595074:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789049910.595093:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789049910.595108:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789049910.595117:0:6513:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789049910.595262:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789049910.595277:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789049910.595295:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789049910.595328:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789049910.595404:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789049910.595426:0:6513:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789049910.595432:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789049910.595883:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789049910.596330:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789049910.596353:0:6513:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.142@tcp for mdt 20000000:01000000:3.0:1789049910.596355:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789049910.596372:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789049910.596379:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789049910.596404:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789049910.596411:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789049910.596425:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789049910.596433:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789049910.596445:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789049910.596476:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789049910.596506:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789049910.596509:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789049910.596513:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789049910.596573:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789049910.596576:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789049910.596908:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789049910.597142:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789049910.597269:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789049910.597288:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789049910.597297:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789049910.597298:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789049910.597576:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789049910.597724:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789049910.597744:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789049910.597760:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789049910.597769:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049910.597772:0:6513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789049910.597775:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789049910.597777:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789049910.597782:0:6513:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789049910.597788:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789049910.599460:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789049910.599611:0:6513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789049910.608322:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789049910.608361:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789049910.608377:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789049910.608405:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789049910.608430:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608478:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608485:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608492:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608498:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608505:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea8d81c6 already unused, calling callback (00000000ff6fa21f) 00010000:00010000:0.0:1789049910.608508:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608655:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608669:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608676:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.608681:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ec8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049910.608712:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789049910.617561:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc18f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+5:6495:x1875954714542336:12345-0@lo:253: Request processed in 30464us (30680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.617584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049910.618331:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542336:0@lo:253: 10000000:01000000:2.0:1789049910.618353:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789049910.618356:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049910.618358:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789049910.618359:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049910.618360:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789049910.618361:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049910.618363:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049910.618363:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049910.618365:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789049910.618366:0:6495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789049910.618367:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049910.618368:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789049910.618399:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd173719 from lustre-MDT0000 10000000:01000000:2.0:1789049910.618431:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789049910.618434:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789049910.618439:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8baa857ab380 10000000:01000000:2.0:1789049910.618443:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789049910.618451:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857ab380 from 1 10000000:01000000:2.0:1789049910.618453:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789049910.618501:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.618511:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.618519:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.618538:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542464:0@lo:101: 00000100:00100000:2.0:1789049910.618595:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.618648:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000d5a63d going to sleep for 11 seconds 00000100:00100000:0.0:1789049910.619510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542464 00000100:00100000:0.0:1789049910.619521:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542464 00000100:00100000:0.0:1789049910.619572:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049910.619581:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000077db44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+5:6495:x1875954714542464:12345-0@lo:101: 00010000:00010000:0.0:1789049910.619595:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049910.619610:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56ecf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.619635:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.619646:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.619653:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea8d81c6, rc 0) 00000100:00100000:0.0:1789049910.619729:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000077db44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+6:6495:x1875954714542464:12345-0@lo:101: Request processed in 148us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049910.619735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049910.622458:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542464:0@lo:101: 00010000:00010000:3.0:1789049910.622490:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.622503:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049910.622644:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6e9deb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542592:0@lo:501: 00000100:00100000:3.0:1789049910.622708:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049910.622757:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000002922ba3f going to sleep for 11 seconds 00000100:00100000:0.0:1789049910.622825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542592 00000100:00100000:0.0:1789049910.623304:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542592 00000100:00100000:0.0:1789049910.623366:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049910.623375:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d030b0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+6:6495:x1875954714542592:12345-0@lo:501: 00000100:00100000:0.0:1789049910.623541:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d030b0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+6:6495:x1875954714542592:12345-0@lo:501: Request processed in 167us (833us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049910.623550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049910.624072:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6e9deb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542592:0@lo:501: 10000000:01000000:2.0:1789049910.624107:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789049910.624157:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.624168:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049910.624186:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baaac606800 10000000:01000000:2.0:1789049910.624191:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789049910.624197:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8baaac606800 10000000:01000000:2.0:1789049910.624200:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789049910.624203:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8baaac606800 from 1 10000000:01000000:2.0:1789049910.624206:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789049910.624237:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.624245:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.624254:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.624269:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542720:0@lo:101: 00000100:00100000:2.0:1789049910.624310:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.624348:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e7dbfd going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.624410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542720 00000100:00100000:3.0:1789049910.624417:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542720 00000100:00100000:3.0:1789049910.624457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049910.624463:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be260598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+6:6495:x1875954714542720:12345-0@lo:101: 00010000:00010000:3.0:1789049910.624473:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049910.624496:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004deb8c62/0x3b8ec5973df56ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56edd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.624517:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004deb8c62/0x3b8ec5973df56ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56edd expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.624527:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004deb8c62/0x3b8ec5973df56ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56edd expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.624535:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004deb8c62, rc 0) 00000100:00100000:3.0:1789049910.624568:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be260598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+7:6495:x1875954714542720:12345-0@lo:101: Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.624574:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049910.624864:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542720:0@lo:101: 00010000:00010000:2.0:1789049910.624893:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.624900:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049910.624913:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789049910.625328:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.625337:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000a61bfc73/0x3b8ec5973df56edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049910.625345:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789049910.625350:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789049910.625355:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8baaac606800 10000000:01000000:2.0:1789049910.625358:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789049910.625361:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789049910.625363:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049910.625395:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.625402:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.625409:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.625423:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542848:0@lo:101: 00000100:00100000:2.0:1789049910.625460:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049910.625588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542848 00000100:00100000:1.0:1789049910.625596:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542848 00000100:00100000:1.0:1789049910.625676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049910.625684:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016daae7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+7:6495:x1875954714542848:12345-0@lo:101: 00010000:00010000:1.0:1789049910.625695:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049910.625706:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56eeb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.625741:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.625750:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.625757:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d475ce9b, rc 0) 00000100:00100000:1.0:1789049910.625961:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016daae7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+8:6495:x1875954714542848:12345-0@lo:101: Request processed in 278us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.625969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049910.626134:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e7dbfd going to sleep for 11 seconds 00000100:00100000:2.0:1789049910.626150:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542848:0@lo:101: 00010000:00010000:2.0:1789049910.626162:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.626170:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.626314:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542976:0@lo:501: 00000100:00100000:2.0:1789049910.626342:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.626604:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e7dbfd going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.626650:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714542976 00000100:00100000:3.0:1789049910.626657:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714542976 00000100:00100000:3.0:1789049910.626764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049910.626772:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000390486c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+8:6495:x1875954714542976:12345-0@lo:501: 00000100:00100000:3.0:1789049910.626929:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000390486c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+9:6495:x1875954714542976:12345-0@lo:501: Request processed in 158us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.627977:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714542976:0@lo:501: 00000100:00100000:2.0:1789049910.628104:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543104:0@lo:503: 00000100:00100000:2.0:1789049910.628269:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.628383:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e7dbfd going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.628446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543104 00000100:00100000:1.0:1789049910.628453:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543104 00000100:00100000:1.0:1789049910.628538:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049910.628547:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0d3b13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543104:12345-0@lo:503: 00000100:00100000:1.0:1789049910.628674:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0d3b13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543104:12345-0@lo:503: Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.628681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049910.629116:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543104:0@lo:503: 00000100:00100000:3.0:1789049910.629366:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049910.629608:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070bcc897 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6540:1875954714543232:0@lo:502: 00000100:00100000:0.0:1789049910.629662:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.629694:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 000000008bc37b57 going to sleep for 11 seconds 00000100:00100000:2.0:1789049910.629769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543232 00000100:00100000:2.0:1789049910.629776:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543232 00000100:00100000:2.0:1789049910.629868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049910.629874:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c13649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+9:6540:x1875954714543232:12345-0@lo:502: 00000100:00100000:2.0:1789049910.629997:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c13649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+9:6540:x1875954714543232:12345-0@lo:502: Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.630014:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070bcc897 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6540:1875954714543232:0@lo:502: 00000020:01000000:3.0:1789049910.630038:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049910.630049:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049910.630051:0:6540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789049910.630057:0:6540:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789049910.630060:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049910.630074:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e56dd5e3) 00000020:00000080:3.0:1789049910.630092:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789049910.630098:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789049910.630250:0:6540:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789049910.630260:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df56f00 00000100:00100000:2.0:1789049910.630361:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:3.0:1789049910.630474:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789049910.630478:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049910.630482:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049910.630483:0:6540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789049910.630486:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049910.630546:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049910.630549:0:6540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789049910.630562:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049910.630569:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c87494b3) 00000020:00000080:3.0:1789049910.630576:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789049910.630578:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789049910.630579:0:6540:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789049910.630581:0:6540:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789049910.630584:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049910.630613:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd173719 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789049910.630795:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000050a2d8fe) 00000020:00000080:3.0:1789049910.630807:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789049910.630875:0:6540:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789049910.630882:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df56f15 00000020:00000080:3.0:1789049910.631003:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789049910.631010:0:6540:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789049910.631014:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3b8ec5973df56f1c 00080000:01000000:3.0:1789049910.631019:0:6540:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789049910.631022:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df56f23 00080000:10000000:3.0:1789049910.631547:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789049910.631653:0:6540:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789049910.639005:0:6540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789049910.696651:0:6540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789049910.697049:0:6540:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789049910.699934:0:6540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789049910.700510:0:6540:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789049910.710394:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ec128521) 00000020:00000080:1.0:1789049910.710419:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789049910.711699:0:6540:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789049910.712161:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df56f31 00000020:00000080:0.0:1789049910.715568:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789049910.717102:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789049910.720219:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789049910.723160:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789049910.724871:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789049910.728849:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789049910.733918:0:6540:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789049910.736186:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3b8ec5973df56f38 00000020:00000080:1.0:1789049910.737687:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789049910.737701:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049910.737709:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049910.737711:0:6540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789049910.737714:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049910.737727:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049910.737729:0:6540:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049910.737732:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049910.737734:0:6540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789049910.737737:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049910.737739:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049910.737741:0:6540:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789049910.737743:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049910.737748:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049910.737749:0:6540:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789049910.737753:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789049910.737799:0:6540:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789049910.737863:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c137efa pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6540:1875954714543360:0@lo:502: 00000100:00100000:1.0:1789049910.737982:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049910.738085:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 00000000232f2f01 going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.739579:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543360 00000100:00100000:3.0:1789049910.739592:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543360 00000100:00100000:3.0:1789049910.739686:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049910.739695:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d62d0323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+9:6540:x1875954714543360:12345-0@lo:502: 00000100:00100000:3.0:1789049910.739847:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d62d0323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+9:6540:x1875954714543360:12345-0@lo:502: Request processed in 154us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.739855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049910.739952:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c137efa pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6540:1875954714543360:0@lo:502: 00000020:01000000:0.0:1789049910.739984:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049910.739991:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049910.739993:0:6540:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789049910.739997:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789049910.740340:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789049910.740365:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789049910.740439:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.741309:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049910.741322:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baaac606800 from 1 10000000:01000000:2.0:1789049910.741325:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789049910.741364:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.741372:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.741391:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.741412:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543488:0@lo:101: 00000100:00100000:2.0:1789049910.741618:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.741662:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc6a8ed7 going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.741801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543488 00000100:00100000:1.0:1789049910.741810:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543488 00000100:00100000:1.0:1789049910.741877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789049910.741885:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bab98be9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+9:6495:x1875954714543488:12345-0@lo:101: 00010000:00010000:1.0:1789049910.741898:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049910.741912:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56f3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.741951:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.741964:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.741973:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5301538, rc 0) 00000100:00100000:1.0:1789049910.742013:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bab98be9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543488:12345-0@lo:101: Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.742031:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049910.742118:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543488:0@lo:101: 00010000:00010000:2.0:1789049910.742143:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.742152:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.742929:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543616:0@lo:256: 00000100:00100000:2.0:1789049910.743028:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.743070:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc6a8ed7 going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.743089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543616 00000100:00100000:3.0:1789049910.743096:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543616 00000100:00100000:3.0:1789049910.743136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049910.743144:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6666788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543616:12345-0@lo:256: 20000000:01000000:3.0:1789049910.743161:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789049910.743166:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789049910.743239:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6666788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543616:12345-0@lo:256: Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.743247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049910.743347:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543616:0@lo:256: 10000000:01000000:0.0:1789049910.745887:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049910.745919:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.745952:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049910.745963:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac606800 from 1 10000000:01000000:0.0:1789049910.745966:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049910.746013:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.746031:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.746042:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049910.746064:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543744:0@lo:101: 00000100:00100000:0.0:1789049910.747618:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.747687:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2ad28f going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.748482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543744 00000100:00100000:3.0:1789049910.748494:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543744 00000100:00100000:3.0:1789049910.748552:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049910.748561:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008801dc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+10:6495:x1875954714543744:12345-0@lo:101: 00010000:00010000:3.0:1789049910.748578:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049910.748608:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56f4d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.748634:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.748644:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.748653:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000caf4015, rc 0) 00000100:00100000:3.0:1789049910.748724:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008801dc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714543744:12345-0@lo:101: Request processed in 164us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.748731:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049910.749614:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543744:0@lo:101: 00010000:00010000:0.0:1789049910.749638:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.749647:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049910.749728:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543872:0@lo:501: 00000100:00100000:0.0:1789049910.749775:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.749818:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2ad28f going to sleep for 11 seconds 00000100:00100000:2.0:1789049910.749880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714543872 00000100:00100000:2.0:1789049910.749888:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714543872 00000100:00100000:2.0:1789049910.749950:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049910.749962:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000499a8f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714543872:12345-0@lo:501: 00000100:00100000:2.0:1789049910.750126:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000499a8f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714543872:12345-0@lo:501: Request processed in 167us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.750134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049910.753997:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714543872:0@lo:501: 00000100:00100000:0.0:1789049910.754077:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544000:0@lo:503: 00000100:00100000:0.0:1789049910.754159:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.754206:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2ad28f going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.754267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544000 00000100:00100000:1.0:1789049910.754276:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544000 00000100:00100000:1.0:1789049910.754332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049910.754346:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081ffaf66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714544000:12345-0@lo:503: 00000040:00080000:1.0:1789049910.754407:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049910.754470:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081ffaf66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714544000:12345-0@lo:503: Request processed in 130us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.754478:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049910.754567:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df364c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544000:0@lo:503: 00000040:00080000:0.0:1789049910.755354:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789049910.755506:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789049910.755525:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049910.755545:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.755556:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049910.755601:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789049910.755604:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baaac606800 10000000:01000000:1.0:1789049910.755607:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baaac606800 10000000:01000000:1.0:1789049910.755611:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049910.755617:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac606800 from 1 10000000:01000000:1.0:1789049910.755620:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049910.755651:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.755660:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049910.755680:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049910.755695:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000981be852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544128:0@lo:101: 00000100:00100000:1.0:1789049910.755738:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049910.755772:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000232f2f01 going to sleep for 11 seconds 00000100:00100000:2.0:1789049910.755913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544128 00000100:00100000:2.0:1789049910.755921:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544128 00000100:00100000:2.0:1789049910.755982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049910.755991:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cc564ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:6495:x1875954714544128:12345-0@lo:101: 00010000:00010000:2.0:1789049910.756003:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049910.756016:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56f5b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.756037:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.756048:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.756055:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd121f8a, rc 0) 00000100:00100000:2.0:1789049910.756089:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cc564ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544128:12345-0@lo:101: Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.756095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049910.756134:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000981be852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544128:0@lo:101: 00010000:00010000:2.0:1789049910.756148:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.756166:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.756220:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000cf2a175 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544256:0@lo:501: 00000100:00100000:2.0:1789049910.756248:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.756279:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d7b74e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.756337:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544256 00000100:00100000:1.0:1789049910.756342:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544256 00000100:00100000:1.0:1789049910.756373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049910.756379:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a84b6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544256:12345-0@lo:501: 00000100:00100000:1.0:1789049910.756500:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a84b6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544256:12345-0@lo:501: Request processed in 121us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.756507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049910.756574:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000cf2a175 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544256:0@lo:501: 00000100:00100000:2.0:1789049910.756598:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000cf2a175 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544384:0@lo:503: 00000100:00100000:2.0:1789049910.756635:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.756654:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d7b74e4 going to sleep for 11 seconds 00000100:00100000:3.0:1789049910.756840:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544384 00000100:00100000:3.0:1789049910.756846:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544384 00000100:00100000:3.0:1789049910.756885:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049910.756892:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc8f7ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544384:12345-0@lo:503: 00000100:00100000:3.0:1789049910.757415:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc8f7ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544384:12345-0@lo:503: Request processed in 522us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049910.757423:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789049910.761718:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000cf2a175 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544384:0@lo:503: 00000100:00100000:3.0:1789049910.762420:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022a16fb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6545:1875954714544512:0@lo:502: 00000100:00100000:3.0:1789049910.762500:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049910.762551:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a428809c going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.762783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544512 00000100:00100000:1.0:1789049910.762791:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544512 00000100:00100000:1.0:1789049910.762839:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049910.762847:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d24d370b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6545:x1875954714544512:12345-0@lo:502: 00000100:00100000:1.0:1789049910.765520:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d24d370b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6545:x1875954714544512:12345-0@lo:502: Request processed in 2663us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049910.765540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049910.766218:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022a16fb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6545:1875954714544512:0@lo:502: 00000020:01000004:2.0:1789049910.766309:0:6545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789049910.766325:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006bad191a) 00000020:00000080:2.0:1789049910.766345:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789049910.767227:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd173719 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789049910.767234:0:6545:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bd173719 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789049910.767236:0:6545:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bd173719 4 00010000:00080000:2.0:1789049910.767275:0:6545:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b2eddab2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789049910.769725:0:6545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789049910.770003:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789049910.770050:0:6545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789049910.770062:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3b8ec5973df56f70 00000100:00080000:2.0:1789049910.770072:0:6545:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049910.770083:0:6545:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2eddab2 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789049910.770121:0:6545:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc984ed0 x1875954714544640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049910.770159:0:6545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789049910.770255:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc984ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714544640:0@lo:38: 00000100:00100000:0.0:1789049910.770332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.774237:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e26906c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6545:1875954714544768:0@lo:502: 00000100:00100000:0.0:1789049910.774323:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049910.774366:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2ad28f going to sleep for 11 seconds 00000100:00100000:2.0:1789049910.774496:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544768 00000100:00100000:2.0:1789049910.774505:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544768 00000100:00100000:2.0:1789049910.774556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049910.774564:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023acd86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:6545:x1875954714544768:12345-0@lo:502: 00000100:00100000:2.0:1789049910.774687:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023acd86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:6545:x1875954714544768:12345-0@lo:502: Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.774696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049910.774834:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e26906c pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:6545:1875954714544768:0@lo:502: 00000040:00080000:0.0:1789049910.774861:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789049910.775012:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789049910.775032:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049910.775083:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.775094:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789049910.775144:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789049910.775146:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789049910.775147:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049910.775148:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049910.775149:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049910.775151:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049910.775152:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049910.775153:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789049910.775154:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049910.775155:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049910.775157:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049910.775158:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049910.775161:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789049910.775163:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049910.775165:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789049910.775169:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049910.775170:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049910.775171:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049910.775172:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049910.775172:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049910.775173:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789049910.775174:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049910.775175:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049910.775176:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049910.775176:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049910.775194:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789049910.775202:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d5a9c62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544896:0@lo:253: 00000100:00100000:2.0:1789049910.775236:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049910.775267:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000003201083b going to sleep for 11 seconds 00000100:00100000:1.0:1789049910.775340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544896 00000100:00100000:1.0:1789049910.775347:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544896 00000100:00100000:1.0:1789049910.775381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049910.775399:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040c74e02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544896:12345-0@lo:253: 20000000:01000000:1.0:1789049910.775421:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789049910.775440:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789049910.775821:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714544640 00000100:00100000:1.0:1789049910.775827:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714544640 00000100:00100000:1.0:1789049910.775862:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049910.775867:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df364c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714544640:12345-0@lo:38: 00000100:00100000:1.0:1789049910.775930:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df364c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714544640:12345-0@lo:38: Request processed in 62us (5598us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789049910.775964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049910.782051:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049910.782063:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000b2eddab2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789049910.782072:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789049910.782076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc984ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714544640:0@lo:38: 20000000:01000000:2.0:1789049910.784040:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789049910.784056:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789049910.784320:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040c74e02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6495:x1875954714544896:12345-0@lo:253: Request processed in 8919us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.784333:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049910.784437:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d5a9c62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:6495:1875954714544896:0@lo:253: 10000000:01000000:1.0:1789049910.784452:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789049910.784455:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049910.784457:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789049910.784458:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049910.784460:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049910.784461:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049910.784462:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049910.784463:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789049910.784465:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789049910.784466:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049910.784467:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049910.784469:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049910.784470:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789049910.784484:0:6495:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789049910.786053:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789049910.786062:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789049910.786087:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.786103:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.786124:0:6534:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.786164:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.786179:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 11 pid: 6512 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049910.786194:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714545024:0@lo:104: 00000100:00100000:3.0:1789049910.786248:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049910.786422:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cfb45da going to sleep for 11 seconds 00080000:10000000:1.0:1789049910.789655:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.789857:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:0.0:1789049910.790105:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545024 00000100:00100000:0.0:1789049910.790117:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545024 00000100:00100000:0.0:1789049910.790168:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049910.790177:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001fc09a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714545024:12345-0@lo:104: 00010000:00010000:0.0:1789049910.790194:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049910.790280:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049910.790285:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001fc09a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714545024:12345-0@lo:104: Request processed in 110us (4038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049910.790291:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049910.790415:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714545024:0@lo:104: 00010000:00010000:3.0:1789049910.790440:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789049910.790923:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.791467:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789049910.791679:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.791836:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1789049910.792705:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049910.792714:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.792723:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0546970 already unused, calling callback (0000000023d56a7f) 10000000:00010000:2.0:1789049910.792727:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.792736:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049910.792749:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049910.792755:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049910.792810:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.792816:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049910.792836:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.792842:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000f0546970/0x3b8ec5973df56f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.792862:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049910.792864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049910.792865:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049910.793049:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc984ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714545152:0@lo:103: 00000100:00100000:0.0:1789049910.793113:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1789049910.793647:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.793827:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789049910.794066:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.794244:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00000100:00100000:2.0:1789049910.794663:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545152 00000100:00100000:2.0:1789049910.794673:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545152 00010000:00010000:2.0:1789049910.794706:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 12 pid: 6512 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049910.794745:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049910.794754:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e26906c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+12:3645:x1875954714545152:12345-0@lo:103: 00010000:00010000:2.0:1789049910.794767:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049910.794772:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 12 pid: 6512 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794782:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 12 pid: 6512 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794807:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5301538/0x3b8ec5973df56f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56f3f expref: 12 pid: 6512 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794825:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794832:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789049910.794847:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008786538s 00010000:00010000:2.0:1789049910.794852:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794859:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794865:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794872:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794880:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f48f49dd already unused, calling callback (00000000ff6fa21f) 00010000:00010000:2.0:1789049910.794883:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794890:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794913:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049910.794949:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049910.795012:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e26906c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+11:3645:x1875954714545152:12345-0@lo:103: Request processed in 259us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049910.795019:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049910.795062:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc984ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714545152:0@lo:103: 00010000:00010000:3.0:1789049910.795875:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.795887:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049910.795894:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f48f49dd/0x3b8ec5973df56f77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789049910.796091:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1789049910.796329:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789049910.799525:0:6495:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789049910.812121:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789049910.812475:0:6551:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789049910.813968:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789049910.814082:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789049910.815370:0:6550:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789049910.815377:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:2.0:1789049910.815526:0:6495:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789049910.815539:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789049910.817776:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049910.818558:0:6551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049910.818718:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789049910.819776:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789049910.819819:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789049910.820188:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789049910.821068:0:6495:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789049910.825308:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:3.0:1789049910.828913:0:6551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789049910.829016:0:6551:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789049910.829021:0:6551:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789049910.829291:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789049910.829744:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789049910.829864:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789049910.830019:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789049910.830130:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789049910.830273:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789049910.830403:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789049910.830745:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789049910.830872:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789049910.831018:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789049910.831133:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789049910.831266:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789049910.831429:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789049910.833214:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789049910.833402:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789049910.834931:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789049910.835119:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789049910.835255:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789049910.835400:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789049910.835621:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789049910.835774:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789049910.835908:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789049910.836074:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789049910.836206:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789049910.836356:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789049910.836508:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789049910.836644:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789049910.836797:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789049910.836997:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789049910.837139:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789049910.837284:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789049910.840372:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789049910.852919:0:6495:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789049910.853016:0:6495:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaeaec1c7b988 00100000:10000000:2.0:1789049910.853023:0:6495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789049910.853817:0:6495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049910.853833:0:6495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049910.853855:0:6495:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789049910.853878:0:6495:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789049910.855028:0:6495:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049910.855205:0:6495:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789049911.405123:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049912.430089:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049913.449766:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049914.473312:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789049915.038851:0:6796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049915.497806:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789049916.010160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789049916.010176:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789049916.010180:0:36:0:(import.c:65:import_set_state_nolock()) 00000000b2eddab2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789049916.010206:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2eddab2 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789049916.010233:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ece2f882 x1875954714545408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049916.010543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e58be39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714545280:0@lo:400: 00000100:00100000:0.0:1789049916.010633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049916.010715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545280 00000100:00100000:0.0:1789049916.010724:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545280 00000100:00100000:0.0:1789049916.010774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049916.010796:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054edc77b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:3646:x1875954714545280:12345-0@lo:400: 00000100:00100000:0.0:1789049916.010867:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054edc77b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:3646:x1875954714545280:12345-0@lo:400: Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049916.010875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049916.010932:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e58be39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714545280:0@lo:400: 00000100:00100000:2.0:1789049916.011586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ece2f882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714545408:0@lo:38: 00000100:00100000:2.0:1789049916.011640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049916.011747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545408 00000100:00100000:1.0:1789049916.011755:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545408 00000100:00100000:1.0:1789049916.011798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049916.011803:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc984ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714545408:12345-0@lo:38: 00010000:00080000:1.0:1789049916.011834:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:1.0:1789049916.011882:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3b8ec5973df56f7e 00000004:00100000:1.0:1789049916.012040:0:6520:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789049916.012218:0:6520:0:(import.c:65:import_set_state_nolock()) 000000005e4b720d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049916.012286:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc984ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875954714545408:12345-0@lo:38: Request processed in 481us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049916.012294:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789049916.012619:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ece2f882 x1875954714545408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789049916.012637:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789049916.012645:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789049916.012650:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789049916.012653:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000b2eddab2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789049916.012659:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ece2f882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714545408:0@lo:38: 00000020:00000004:3.0:1789049916.028375:0:6848:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049916.028655:0:6848:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789049916.521078:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049917.545180:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789049918.057123:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789049918.057134:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baaac606800 from 3 10000000:01000000:0.0:1789049918.057141:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049918.057541:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049918.057555:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049918.057566:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049918.057592:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000684235c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714545536:0@lo:101: 00000100:00100000:0.0:1789049918.057668:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049918.057755:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b63acf1a going to sleep for 11 seconds 00000100:00100000:2.0:1789049918.057923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545536 00000100:00100000:2.0:1789049918.057933:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545536 00000100:00100000:2.0:1789049918.058011:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789049918.058019:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bddde043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+11:6515:x1875954714545536:12345-0@lo:101: 00010000:00010000:2.0:1789049918.058035:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049918.058048:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56f85 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049918.058072:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049918.058083:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049918.058090:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0546970, rc 0) 00000100:00100000:2.0:1789049918.058136:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bddde043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:6515:x1875954714545536:12345-0@lo:101: Request processed in 118us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049918.058143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049918.058979:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000684235c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714545536:0@lo:101: 00010000:00010000:1.0:1789049918.059008:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049918.059018:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049918.059078:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714545664:0@lo:256: 00000100:00100000:1.0:1789049918.059139:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049918.059175:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac08ce10 going to sleep for 11 seconds 00000100:00100000:0.0:1789049918.059500:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545664 00000100:00100000:0.0:1789049918.059508:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545664 00000100:00100000:0.0:1789049918.059554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049918.059562:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007581cd04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:6515:x1875954714545664:12345-0@lo:256: 20000000:01000000:0.0:1789049918.059580:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789049918.059595:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789049918.059598:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789049918.059687:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007581cd04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:6515:x1875954714545664:12345-0@lo:256: Request processed in 125us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049918.059695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049918.059869:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714545664:0@lo:256: 10000000:01000000:1.0:1789049918.059917:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789049918.059924:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049918.059932:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049918.570524:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789049918.980856:0:6949:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049918.981095:0:6949:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789049919.594852:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049920.618121:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049921.129372:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebfb877c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714545920:0@lo:400: 00000100:00100000:0.0:1789049921.129581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714545792:0@lo:400: 00000100:00100000:0.0:1789049921.129625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049921.129697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545792 00000100:00100000:0.0:1789049921.129705:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545792 00000100:00100000:0.0:1789049921.129751:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049921.129759:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fef9858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:3647:x1875954714545792:12345-0@lo:400: 00000100:00100000:0.0:1789049921.129813:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fef9858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:3647:x1875954714545792:12345-0@lo:400: Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049921.129820:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049921.129865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714545792:0@lo:400: 00000100:00100000:1.0:1789049921.129929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049921.132002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714545920 00000100:00100000:0.0:1789049921.132019:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714545920 00000100:00100000:0.0:1789049921.132087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049921.132097:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076aff0ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714545920:12345-0@lo:400: 00000100:00100000:0.0:1789049921.132200:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076aff0ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714545920:12345-0@lo:400: Request processed in 105us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049921.132207:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789049921.132267:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ebfb877c x1875954714545920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049921.132283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebfb877c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714545920:0@lo:400: 00010000:00010000:2.0:1789049921.641225:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049922.665032:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049923.689818:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049924.714488:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049925.737776:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049926.253820:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049926.253854:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714546048:0@lo:400: 00000100:00100000:2.0:1789049926.253978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.254059:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546048 00000100:00100000:2.0:1789049926.254076:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546048 00000100:00100000:2.0:1789049926.254135:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049926.254144:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069f4359d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:3644:x1875954714546048:12345-0@lo:400: 00000100:00100000:2.0:1789049926.254203:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069f4359d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:3644:x1875954714546048:12345-0@lo:400: Request processed in 61us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.254212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049926.254269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714546048:0@lo:400: 00000100:00100000:1.0:1789049926.262271:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099fb7b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714546176:0@lo:400: 00000100:00100000:1.0:1789049926.264081:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.264422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546176 00000100:00100000:2.0:1789049926.264435:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546176 00000100:00100000:3.0:1789049926.267687:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049926.275210:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f2fbe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714546176:12345-0@lo:400: 00000100:00100000:3.0:1789049926.275375:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f2fbe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714546176:12345-0@lo:400: Request processed in 7671us (11301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049926.275387:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789049926.275605:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000099fb7b68 x1875954714546176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049926.275623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099fb7b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714546176:0@lo:400: 00010000:00010000:1.0:1789049926.770912:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049927.788179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789049928.530571:0:7448:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789049928.530576:0:7448:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789049928.530578:0:7448:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789049928.530690:0:7448:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000481b350d 00000020:01000004:0.0:1789049928.530709:0:7448:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789049928.530722:0:7448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789049928.530755:0:7448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000aa746519) 00000020:00000080:0.0:1789049928.530774:0:7448:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789049928.616024:0:7448:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789049928.616097:0:7448:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789049928.640716:0:7448:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789049928.640970:0:7448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789049928.641297:0:7448:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789049928.641311:0:7448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df56f9a 00000020:01000004:3.0:1789049928.641319:0:7448:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789049928.641343:0:7448:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789049928.641347:0:7448:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789049928.641354:0:7448:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789049928.641384:0:7448:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789049928.641490:0:7448:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789049928.692669:0:7448:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789049928.692713:0:7448:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789049928.692717:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789049928.692719:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789049928.692720:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049928.692721:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049928.692723:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049928.692725:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049928.692726:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049928.692727:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049928.692729:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049928.692731:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049928.692734:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049928.692738:0:7448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789049928.692741:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049928.692743:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789049928.692744:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049928.692746:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049928.692747:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049928.692749:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049928.692755:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049928.692756:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049928.692757:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049928.692757:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049928.692758:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049928.692799:0:7448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789049928.692819:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a079595 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714546304:0@lo:253: 00000100:00100000:2.0:1789049928.693115:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.693217:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000004ed08d going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.693336:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546304 00000100:00100000:0.0:1789049928.693346:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546304 00000100:00100000:0.0:1789049928.693433:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049928.693441:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d80c7ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714546304:12345-0@lo:253: 20000000:01000000:0.0:1789049928.693484:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789049928.693489:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789049928.693493:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789049928.693496:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789049928.693532:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789049928.693723:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049928.693898:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789049928.693914:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789049928.693993:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789049928.694013:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789049928.694027:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789049928.694076:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789049928.694084:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789049928.694101:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789049928.694106:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789049928.694117:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789049928.694129:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789049928.694145:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789049928.694159:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789049928.694351:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789049928.694361:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789049928.694374:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789049928.694379:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789049928.694391:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789049928.694397:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:0.0:1789049928.694409:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789049928.694415:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789049928.694428:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789049928.694443:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789049928.694453:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789049928.694535:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789049928.694545:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789049928.694558:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789049928.694574:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789049928.694589:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789049928.694594:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789049928.694605:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789049928.694625:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789049928.694630:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789049928.694653:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789049928.694660:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789049928.700666:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789049928.701027:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789049928.701064:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.142@tcp for mdt 20000000:01000000:0.0:1789049928.701067:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789049928.701084:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789049928.701090:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789049928.701128:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789049928.701134:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:0.0:1789049928.701153:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789049928.701162:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789049928.701176:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789049928.701192:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789049928.701252:0:6510:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789049928.701276:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789049928.701817:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789049928.702151:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789049928.702176:0:6510:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.142@tcp for mdt 20000000:01000000:2.0:1789049928.702178:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:2.0:1789049928.702204:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789049928.702210:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789049928.702221:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789049928.702226:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:2.0:1789049928.702237:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789049928.702244:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789049928.702255:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789049928.702282:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789049928.702307:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789049928.702310:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789049928.702313:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789049928.702358:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789049928.702360:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049928.707759:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049928.707848:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049928.707866:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789049928.708130:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789049928.708170:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789049928.708186:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789049928.708196:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789049928.708198:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789049928.709049:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789049928.709074:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789049928.709099:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789049928.709283:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789049928.709314:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789049928.709339:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789049928.709348:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789049928.709349:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789049928.709744:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789049928.709763:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789049928.709778:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789049928.709922:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789049928.709986:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789049928.710011:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789049928.710031:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789049928.710033:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789049928.710039:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789049928.710046:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789049928.711862:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789049928.719421:0:6510:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789049928.735777:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049928.736117:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736139:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736146:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736152:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736158:0:6510:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736200:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736215:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 12 pid: 6513 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.736228:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fbc7b98 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546432:0@lo:104: 00000100:00100000:2.0:1789049928.736474:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049928.736603:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736625:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 12 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.736633:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0965ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546560:0@lo:104: 00000100:00100000:2.0:1789049928.736656:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049928.736723:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.736731:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 12 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.736739:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054facbc8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546688:0@lo:104: 00000100:00100000:2.0:1789049928.736759:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.741603:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3f97746 going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.741679:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546432 00000100:00100000:1.0:1789049928.741692:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546432 00000100:00100000:1.0:1789049928.741745:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546560 00000100:00100000:1.0:1789049928.741748:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546560 00000100:00100000:1.0:1789049928.741761:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546688 00000100:00100000:1.0:1789049928.741764:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546688 00000100:00100000:1.0:1789049928.741779:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049928.741787:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c9ea98d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+5:6510:x1875954714546432:12345-0@lo:104: 00010000:00010000:1.0:1789049928.741804:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.742618:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fbc7b98 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546432:0@lo:104: 00010000:00010000:1.0:1789049928.742687:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049928.742694:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c9ea98d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+5:6510:x1875954714546432:12345-0@lo:104: Request processed in 908us (6221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.742703:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049928.742728:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049928.742736:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000720e287f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6510:x1875954714546560:12345-0@lo:104: 00010000:00010000:1.0:1789049928.742745:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.742851:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789049928.742856:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000720e287f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6510:x1875954714546560:12345-0@lo:104: Request processed in 123us (6200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.742861:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049928.742874:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049928.742880:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d48045d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6510:x1875954714546688:12345-0@lo:104: 00010000:00010000:1.0:1789049928.742972:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743017:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789049928.743021:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d48045d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6510:x1875954714546688:12345-0@lo:104: Request processed in 142us (6262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.743026:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789049928.743045:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789049928.743051:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743058:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032fed865 already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049928.743061:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743068:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049928.743075:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049928.743080:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049928.743117:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743123:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049928.743142:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743147:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df56f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f62 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743170:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049928.743172:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743177:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf50f33a already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049928.743179:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743184:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049928.743189:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049928.743193:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049928.743206:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743211:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049928.743226:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743231:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000bf50f33a/0x3b8ec5973df56eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ef2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743240:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049928.743242:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743273:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000138e5fb5 already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049928.743275:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743281:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049928.743285:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049928.743290:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049928.743408:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.743490:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743496:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049928.743502:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743507:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56ed6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.743520:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.743522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.743524:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049928.743546:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fb4c166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714546816:0@lo:103: 00000100:00100000:1.0:1789049928.743585:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.743651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f21661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714546944:0@lo:103: 00000100:00100000:1.0:1789049928.743673:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.743702:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049928.743708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025319b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714547072:0@lo:103: 00000100:00100000:1.0:1789049928.743729:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.743764:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546816 00000100:00100000:1.0:1789049928.743770:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546816 00010000:00010000:1.0:1789049928.743793:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 13 pid: 6513 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049928.743809:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714546944 00000100:00100000:1.0:1789049928.743812:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714546944 00010000:00010000:1.0:1789049928.743823:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 14 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049928.743833:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547072 00000100:00100000:1.0:1789049928.743835:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547072 00010000:00010000:1.0:1789049928.743846:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 15 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049928.743858:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049928.743864:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085b50802 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+15:3647:x1875954714546816:12345-0@lo:103: 00010000:00010000:1.0:1789049928.743874:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049928.743878:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 15 pid: 6513 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.744208:0:6503:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789049928.744217:0:6503:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789049928.744343:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049928.744350:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000102c8801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+15:3644:x1875954714546944:12345-0@lo:103: 00010000:00010000:2.0:1789049928.744359:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049928.744363:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 15 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.744419:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 15 pid: 6513 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049928.744895:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0965ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546560:0@lo:104: 00000100:00100000:0.0:1789049928.744908:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054facbc8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714546688:0@lo:104: 00000100:00100000:3.0:1789049928.745719:0:7460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789049928.745728:0:7460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789049928.745805:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 15 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.745830:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df56ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56eeb expref: 15 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.745858:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049928.745958:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000102c8801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+14:3644:x1875954714546944:12345-0@lo:103: Request processed in 1608us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.745967:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049928.745990:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049928.745999:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004eb1379f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+13:3644:x1875954714547072:12345-0@lo:103: 00010000:00010000:2.0:1789049928.746012:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049928.746016:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 13 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.746024:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 13 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.746032:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea8d81c6/0x3b8ec5973df56ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56ecf expref: 13 pid: 6512 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.746041:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049928.746063:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004eb1379f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+12:3644:x1875954714547072:12345-0@lo:103: Request processed in 67us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.746069:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049928.746312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025319b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714547072:0@lo:103: 00000100:00100000:3.0:1789049928.746322:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f21661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714546944:0@lo:103: 00010000:00010000:1.0:1789049928.748722:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df56f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56f5b expref: 11 pid: 6513 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748745:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748769:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748789:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748796:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748802:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748808:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748814:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000070de17f8 already unused, calling callback (00000000ff6fa21f) 00010000:00010000:1.0:1789049928.748817:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748824:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748832:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.748842:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049928.748931:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085b50802 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+10:3647:x1875954714546816:12345-0@lo:103: Request processed in 5067us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.748962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049928.749142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fb4c166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714546816:0@lo:103: 00010000:00010000:0.0:1789049928.750179:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.750350:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.750369:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.750375:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070de17f8/0x3b8ec5973df56fa1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789049928.750405:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789049928.759311:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d80c7ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+9:7448:x1875954714546304:12345-0@lo:253: Request processed in 65855us (66180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.759330:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049928.759645:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a079595 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714546304:0@lo:253: 10000000:01000000:2.0:1789049928.759664:0:7448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789049928.759667:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049928.759669:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789049928.759671:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049928.759672:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789049928.759686:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049928.759688:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049928.759689:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789049928.759691:0:7448:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789049928.759693:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049928.759694:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789049928.759714:0:7448:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000481b350d from lustre-MDT0001 10000000:01000000:2.0:1789049928.759749:0:7448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789049928.759752:0:7448:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789049928.759759:0:7448:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857ab380 local copy 10000000:01000000:2.0:1789049928.759763:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789049928.759800:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.759811:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.759820:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.759838:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a079595 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547200:0@lo:101: 00000100:00100000:2.0:1789049928.759878:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.759992:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd01479a going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.762653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547200 00000100:00100000:0.0:1789049928.762672:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547200 00000100:00100000:1.0:1789049928.762814:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789049928.762826:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000748f20f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+9:7448:x1875954714547200:12345-0@lo:101: 00010000:00010000:1.0:1789049928.762847:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049928.762868:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032fed865/0x3b8ec5973df56faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56fa8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.762905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032fed865/0x3b8ec5973df56faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56fa8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.762918:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032fed865/0x3b8ec5973df56faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56fa8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.762927:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032fed865, rc 0) 00000100:00100000:1.0:1789049928.763031:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000748f20f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+10:7448:x1875954714547200:12345-0@lo:101: Request processed in 207us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.763038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049928.763194:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a079595 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547200:0@lo:101: 00010000:00010000:0.0:1789049928.763213:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.763222:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049928.763372:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0dab937 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547328:0@lo:501: 00000100:00100000:0.0:1789049928.763676:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049928.763718:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074461108 going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.763834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547328 00000100:00100000:1.0:1789049928.763840:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547328 00000100:00100000:1.0:1789049928.763895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049928.763902:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e32be24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+10:7448:x1875954714547328:12345-0@lo:501: 00000100:00100000:1.0:1789049928.764013:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e32be24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+10:7448:x1875954714547328:12345-0@lo:501: Request processed in 112us (337us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049928.764020:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049928.764151:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0dab937 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547328:0@lo:501: 10000000:01000000:3.0:1789049928.764167:0:7448:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789049928.764188:0:7448:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789049928.764192:0:7448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.764200:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.764207:0:7448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.764231:0:7448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789049928.764269:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baab0ea0000 10000000:01000000:3.0:1789049928.764274:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789049928.764279:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8baa857ab380 10000000:01000000:3.0:1789049928.764282:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789049928.764285:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8baa857ab380 from 1 10000000:01000000:3.0:1789049928.764287:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789049928.764321:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.764328:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.764347:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.764360:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547456:0@lo:101: 00000100:00100000:3.0:1789049928.764400:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.764420:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051ecd9d1 going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.764658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547456 00000100:00100000:0.0:1789049928.764663:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547456 00000100:00100000:0.0:1789049928.764685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049928.764690:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009eb7117a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+10:7448:x1875954714547456:12345-0@lo:101: 00010000:00010000:0.0:1789049928.764698:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049928.764710:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000613d6fd6/0x3b8ec5973df56fbd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56fb6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.764728:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000613d6fd6/0x3b8ec5973df56fbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56fb6 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.764736:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000613d6fd6/0x3b8ec5973df56fbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56fb6 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.764743:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000613d6fd6, rc 0) 00000100:00100000:0.0:1789049928.764779:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009eb7117a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:7448:x1875954714547456:12345-0@lo:101: Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.764784:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789049928.764984:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049928.764990:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.764998:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000138e5fb5 already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049928.765000:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.765007:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049928.765013:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049928.765018:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049928.765038:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.765044:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049928.765072:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.765079:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df56fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df56faf expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.765105:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.765107:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.765108:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049928.765117:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049928.765130:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea51a48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714547584:0@lo:103: 00000100:00100000:1.0:1789049928.765171:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.765205:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547584 00000100:00100000:1.0:1789049928.765209:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547584 00000100:00100000:1.0:1789049928.765241:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049928.765247:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007fb4c166 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+11:3647:x1875954714547584:12345-0@lo:103: 00010000:00010000:1.0:1789049928.765272:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049928.765283:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032fed865/0x3b8ec5973df56faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df56fa8 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.765294:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049928.765522:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007fb4c166 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+10:3647:x1875954714547584:12345-0@lo:103: Request processed in 276us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.765528:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049928.765556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea51a48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714547584:0@lo:103: 00000100:00100000:3.0:1789049928.765784:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547456:0@lo:101: 00010000:00010000:3.0:1789049928.765797:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.765805:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049928.765820:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789049928.765836:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.765842:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000f48f49dd/0x3b8ec5973df56fb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049928.765851:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8baab0ea0000 10000000:01000000:3.0:1789049928.765856:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789049928.765861:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8baab0ea0000 from 1 10000000:01000000:3.0:1789049928.765864:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789049928.765882:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.765897:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.765915:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.765930:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547712:0@lo:101: 00000100:00100000:3.0:1789049928.765999:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.766016:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051ecd9d1 going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.766130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547712 00000100:00100000:0.0:1789049928.766143:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547712 00000100:00100000:0.0:1789049928.766185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049928.766193:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1950b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+10:7448:x1875954714547712:12345-0@lo:101: 00010000:00010000:0.0:1789049928.766203:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049928.766212:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae89e5c8/0x3b8ec5973df56fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56fc4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.766228:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae89e5c8/0x3b8ec5973df56fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56fc4 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.766237:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae89e5c8/0x3b8ec5973df56fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56fc4 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.766244:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae89e5c8, rc 0) 00000100:00100000:0.0:1789049928.766296:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1950b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+11:7448:x1875954714547712:12345-0@lo:101: Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.766369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789049928.768461:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547712:0@lo:101: 00010000:00010000:3.0:1789049928.768491:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.768503:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049928.768522:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789049928.768526:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.768534:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000985b620a/0x3b8ec5973df56fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049928.768543:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789049928.768550:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049928.768557:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8baab0ea0000 10000000:01000000:3.0:1789049928.768560:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789049928.768563:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789049928.768565:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789049928.768595:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.768616:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.768626:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.768644:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547840:0@lo:101: 00000100:00100000:3.0:1789049928.768699:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.768794:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051ecd9d1 going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.769711:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547840 00000100:00100000:2.0:1789049928.769723:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547840 00000100:00100000:3.0:1789049928.773915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789049928.773930:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007124e20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+11:7448:x1875954714547840:12345-0@lo:101: 00010000:00010000:3.0:1789049928.773970:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049928.773991:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007e46db03/0x3b8ec5973df56fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df56fd2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.774020:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007e46db03/0x3b8ec5973df56fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.774032:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007e46db03/0x3b8ec5973df56fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.774040:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007e46db03, rc 0) 00000100:00100000:3.0:1789049928.774129:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007124e20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714547840:12345-0@lo:101: Request processed in 202us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049928.774136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049928.774676:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab401460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547840:0@lo:101: 00010000:00010000:2.0:1789049928.774698:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.774708:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.774826:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547968:0@lo:501: 00000100:00100000:2.0:1789049928.774880:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.774929:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bb553fe going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.775015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714547968 00000100:00100000:1.0:1789049928.775023:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714547968 00000100:00100000:1.0:1789049928.775060:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049928.775068:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002718461f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714547968:12345-0@lo:501: 00000100:00100000:1.0:1789049928.775180:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002718461f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714547968:12345-0@lo:501: Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.775197:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049928.775597:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714547968:0@lo:501: 00000100:00100000:2.0:1789049928.775631:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548096:0@lo:503: 00000100:00100000:2.0:1789049928.775673:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.775702:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bb553fe going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.777552:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548096 00000100:00100000:1.0:1789049928.777566:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548096 00000100:00100000:1.0:1789049928.777627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789049928.777637:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008ce6c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548096:12345-0@lo:503: 00000100:00100000:1.0:1789049928.777807:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008ce6c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548096:12345-0@lo:503: Request processed in 171us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.777815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789049928.778002:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548096:0@lo:503: 00000040:00080000:3.0:1789049928.778616:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049928.778706:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548224:0@lo:502: 00000100:00100000:3.0:1789049928.778762:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.778844:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc72edde going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.779859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548224 00000100:00100000:0.0:1789049928.779871:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548224 00000100:00100000:0.0:1789049928.780022:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789049928.780031:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082003946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548224:12345-0@lo:502: 00000100:00100000:0.0:1789049928.780178:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082003946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548224:12345-0@lo:502: Request processed in 148us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.780505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049928.780618:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548224:0@lo:502: 00000040:00080000:3.0:1789049928.780833:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789049928.780865:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789049928.780882:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789049928.780910:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789049928.780925:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789049928.780989:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789049928.781006:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789049928.781019:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789049928.781030:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789049928.781042:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789049928.781053:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789049928.781066:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789049928.781079:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789049928.781093:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789049928.781104:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789049928.781115:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789049928.781126:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789049928.781138:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789049928.781150:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789049928.781162:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789049928.781175:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789049928.781201:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789049928.781217:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789049928.781249:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548352:0@lo:502: 00000100:00100000:3.0:1789049928.781323:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.781359:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc72edde going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.781655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548352 00000100:00100000:2.0:1789049928.781662:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548352 00000100:00100000:2.0:1789049928.781696:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049928.781703:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005542ce66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548352:12345-0@lo:502: 00000100:00100000:2.0:1789049928.781809:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005542ce66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548352:12345-0@lo:502: Request processed in 106us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.781817:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789049928.782078:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548352:0@lo:502: 00000040:00080000:3.0:1789049928.782135:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789049928.782144:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789049928.782797:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049928.782810:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049928.782812:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789049928.782818:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789049928.782822:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049928.782835:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000bcce3ee9) 00000020:00000080:1.0:1789049928.782854:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789049928.782860:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789049928.782987:0:7462:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789049928.783004:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df56fe7 00000020:00000080:1.0:1789049928.783201:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789049928.783205:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049928.783209:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049928.783210:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789049928.783213:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049928.783216:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049928.783217:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789049928.783220:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049928.783226:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000010034017) 00000020:00000080:1.0:1789049928.783238:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789049928.783242:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789049928.783244:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789049928.783247:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789049928.783267:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789049928.783342:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000481b350d from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789049928.783366:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000c4f11fee) 00000020:00000080:1.0:1789049928.783377:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789049928.783745:0:7462:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789049928.783752:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df56ffc 00000020:00000080:1.0:1789049928.783851:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789049928.783857:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789049928.783862:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x3b8ec5973df57003 00080000:01000000:1.0:1789049928.783867:0:7462:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789049928.783871:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df5700a 00080000:10000000:1.0:1789049928.784582:0:7462:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789049928.784767:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789049928.809747:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049928.889818:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789049928.890239:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789049928.893785:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789049928.894318:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789049928.905431:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789049928.905445:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049928.905452:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049928.905455:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789049928.905458:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049928.905464:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049928.905465:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789049928.905469:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789049928.905474:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:00000080:2.0:1789049928.905503:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049928.905516:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000088c13877) 00000020:00000080:2.0:1789049928.905540:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789049928.905546:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789049928.905620:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789049928.905627:0:7462:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789049928.905634:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df57018 00010000:00080000:2.0:1789049928.905676:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000db0bed42@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789049928.910688:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789049928.912458:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789049928.912474:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789049928.912515:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789049928.912536:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df5701f 00000100:00080000:3.0:1789049928.912547:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049928.912558:0:7462:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000db0bed42 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049928.912595:0:7462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000021c8d53 x1875954714548480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049928.912652:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714548480:0@lo:38: 00000100:00100000:0.0:1789049928.912760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.912856:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548480 00000100:00100000:1.0:1789049928.912864:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548480 00000100:00100000:1.0:1789049928.912901:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049928.912907:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fe05dfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714548480:12345-0@lo:38: 00010000:00080000:1.0:1789049928.912931:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000100:00080000:3.0:1789049928.913060:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789049928.913119:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049928.913124:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913126:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789049928.913129:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789049928.913131:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789049928.913133:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789049928.913134:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789049928.913135:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789049928.913137:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913138:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789049928.913141:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049928.913145:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913146:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789049928.913149:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789049928.913192:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789049928.913206:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049928.913209:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913210:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789049928.913213:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049928.913215:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913217:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049928.913220:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049928.913221:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789049928.913249:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049928.913252:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049928.913254:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049928.913267:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789049928.913321:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789049928.913350:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789049928.913365:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.913377:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000000c9e35e0/0x3b8ec5973df56fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049928.913384:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baab0ea0000 from 1 10000000:01000000:3.0:1789049928.913387:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049928.913414:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.913421:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.913429:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.913453:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019dba29e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548608:0@lo:101: 00000100:00100000:3.0:1789049928.913489:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.913520:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef8f225e going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.913706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548608 00000100:00100000:2.0:1789049928.913712:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548608 00000100:00100000:2.0:1789049928.913748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049928.913754:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3d4e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+12:7448:x1875954714548608:12345-0@lo:101: 00010000:00010000:2.0:1789049928.913768:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049928.913780:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5702d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.913801:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.913810:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.913819:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf50f33a, rc 0) 00000100:00100000:0.0:1789049928.913823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096af2769 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714548736:0@lo:400: 00000100:00100000:0.0:1789049928.913856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049928.913901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548736 00000100:00100000:0.0:1789049928.913905:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548736 00000100:00100000:2.0:1789049928.913931:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3d4e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+13:7448:x1875954714548608:12345-0@lo:101: Request processed in 176us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.913931:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049928.913950:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023268888 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714548736:12345-0@lo:400: 00000100:00100000:2.0:1789049928.913957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049928.914020:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019dba29e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548608:0@lo:101: 00010000:00010000:2.0:1789049928.914035:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.914043:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789049928.914176:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df57026 00000004:00100000:1.0:1789049928.914194:0:6523:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789049928.914201:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789049928.914356:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023268888 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714548736:12345-0@lo:400: Request processed in 419us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.914364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789049928.914421:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096af2769 x1875954714548736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049928.914433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096af2769 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714548736:0@lo:400: 00000100:00100000:2.0:1789049928.914787:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548864:0@lo:256: 00000100:00100000:2.0:1789049928.916139:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.916242:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd01479a going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.916344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548864 00000100:00100000:1.0:1789049928.916353:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548864 00000100:00100000:1.0:1789049928.916498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049928.916508:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7af44f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+13:7448:x1875954714548864:12345-0@lo:256: 20000000:01000000:1.0:1789049928.916532:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789049928.916553:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789049928.916559:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789049928.916648:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7af44f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+13:7448:x1875954714548864:12345-0@lo:256: Request processed in 141us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.916657:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789049928.916736:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548864:0@lo:256: 10000000:01000000:2.0:1789049928.918172:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049928.919913:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.919934:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049928.922786:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab0ea0000 from 1 10000000:01000000:2.0:1789049928.922790:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049928.923027:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.923037:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.923048:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.923073:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548992:0@lo:101: 00000100:00100000:2.0:1789049928.923146:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.923903:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd01479a going to sleep for 11 seconds 00000100:00080000:1.0:1789049928.924620:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000d6324381 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049928.924714:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fe05dfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714548480:12345-0@lo:38: Request processed in 11804us (11953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.924726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049928.925326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714548992 00000100:00100000:0.0:1789049928.925338:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714548992 00000100:00100000:2.0:1789049928.925355:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049928.925367:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789049928.925375:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789049928.925382:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049928.925385:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000db0bed42 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789049928.925391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789049928.925403:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000150431f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+13:7448:x1875954714548992:12345-0@lo:101: 00010000:00010000:0.0:1789049928.925415:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789049928.925418:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000021c8d53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714548480:0@lo:38: 00010000:00010000:0.0:1789049928.925433:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5703b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.925461:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.925472:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.925481:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d6651c6, rc 0) 00000100:00100000:0.0:1789049928.925525:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000150431f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:7448:x1875954714548992:12345-0@lo:101: Request processed in 126us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.925531:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789049928.925572:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714549120:0@lo:41: 00000100:00100000:2.0:1789049928.925608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.925667:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714548992:0@lo:101: 00010000:00010000:2.0:1789049928.925685:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.925694:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.925797:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549248:0@lo:501: 00000100:00100000:2.0:1789049928.925824:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.925842:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd01479a going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.925866:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549248 00000100:00100000:0.0:1789049928.925871:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549248 00000100:00100000:3.0:1789049928.925907:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549120 00000100:00100000:3.0:1789049928.925913:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549120 00000100:00100000:3.0:1789049928.925964:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049928.925971:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d5d6691 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714549120:12345-0@lo:41: 00000004:00000024:3.0:1789049928.926069:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789049928.926115:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d5d6691 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714549120:12345-0@lo:41: Request processed in 145us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049928.926121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049928.926212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789049928.926221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056735fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:7448:x1875954714549248:12345-0@lo:501: 00000100:00100000:0.0:1789049928.926349:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056735fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:7448:x1875954714549248:12345-0@lo:501: Request processed in 131us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.926356:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789049928.926417:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714549120:0@lo:41: 00000100:00100000:3.0:1789049928.926421:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549248:0@lo:501: 00000100:00100000:3.0:1789049928.926457:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549376:0@lo:503: 00000100:00100000:3.0:1789049928.926499:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049928.926516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549376 00000100:00100000:1.0:1789049928.926521:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549376 00000100:00100000:3.0:1789049928.926523:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d456e713 going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.926557:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789049928.926605:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b2bee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:7448:x1875954714549376:12345-0@lo:503: 00000040:00080000:2.0:1789049928.926643:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049928.926687:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b2bee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:7448:x1875954714549376:12345-0@lo:503: Request processed in 124us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049928.926828:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549376:0@lo:503: 00000040:00080000:3.0:1789049928.927561:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049928.927611:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789049928.927684:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049928.931062:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789049928.931305:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789049928.931346:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049928.931362:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.931377:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049928.931599:0:7448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789049928.931603:0:7448:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baab0ea0000 10000000:01000000:1.0:1789049928.931607:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baab0ea0000 10000000:01000000:1.0:1789049928.931611:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049928.931618:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab0ea0000 from 1 10000000:01000000:1.0:1789049928.931620:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049928.931664:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.931673:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049928.931684:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049928.931726:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea51a48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549504:0@lo:101: 00000100:00100000:1.0:1789049928.931808:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049928.932116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549504 00000100:00100000:1.0:1789049928.932124:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000638d3aa4 going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.932126:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549504 00000100:00100000:0.0:1789049928.932180:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789049928.932190:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef555df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714549504:12345-0@lo:101: 00010000:00010000:0.0:1789049928.932205:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049928.932218:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ccdae39e/0x3b8ec5973df57050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57049 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.932241:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ccdae39e/0x3b8ec5973df57050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.932252:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ccdae39e/0x3b8ec5973df57050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.932271:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ccdae39e, rc 0) 00000100:00100000:0.0:1789049928.932324:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef555df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:7448:x1875954714549504:12345-0@lo:101: Request processed in 136us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.932332:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049928.932367:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea51a48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549504:0@lo:101: 00010000:00010000:3.0:1789049928.932466:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.932476:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.932668:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549632:0@lo:501: 00000100:00100000:3.0:1789049928.932699:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.932711:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a0797b1 going to sleep for 11 seconds 00000100:00100000:1.0:1789049928.932757:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549632 00000100:00100000:1.0:1789049928.932763:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549632 00000100:00100000:1.0:1789049928.932794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049928.932800:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a744a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:7448:x1875954714549632:12345-0@lo:501: 00000100:00100000:1.0:1789049928.933100:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a744a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:7448:x1875954714549632:12345-0@lo:501: Request processed in 300us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049928.933108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049928.933300:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549632:0@lo:501: 00000100:00100000:3.0:1789049928.933329:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549760:0@lo:503: 00000100:00100000:2.0:1789049928.933351:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049928.933377:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.933588:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a0797b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.933752:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549760 00000100:00100000:2.0:1789049928.933758:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549760 00000100:00100000:2.0:1789049928.938889:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049928.938916:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058b7268d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714549760:12345-0@lo:503: 00000100:00100000:2.0:1789049928.939122:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058b7268d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714549760:12345-0@lo:503: Request processed in 218us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.939141:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049928.939243:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ef0fe9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549760:0@lo:503: 00000040:00080000:2.0:1789049928.939787:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049928.939883:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a1e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549888:0@lo:502: 00000100:00100000:2.0:1789049928.939976:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.940028:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000809de57e going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.940062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714549888 00000100:00100000:2.0:1789049928.940070:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714549888 00000100:00100000:2.0:1789049928.940108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049928.940118:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc5d5f1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714549888:12345-0@lo:502: 00000100:00100000:2.0:1789049928.940366:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc5d5f1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714549888:12345-0@lo:502: Request processed in 250us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.940375:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049928.940494:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a1e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714549888:0@lo:502: 00000040:00080000:2.0:1789049928.940738:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789049928.940772:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789049928.940795:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789049928.940817:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789049928.940851:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789049928.940874:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789049928.940911:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789049928.940931:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789049928.940971:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789049928.940988:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789049928.941003:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789049928.941016:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789049928.941027:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789049928.941038:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789049928.941059:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789049928.941070:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789049928.941082:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789049928.941096:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789049928.941110:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789049928.941124:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789049928.941139:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789049928.941153:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789049928.941180:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789049928.941686:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789049928.941705:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789049928.941718:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789049928.941729:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789049928.941741:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789049928.941772:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a1e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714550016:0@lo:502: 00000100:00100000:2.0:1789049928.942063:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.942099:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d921933c going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.943161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550016 00000100:00100000:0.0:1789049928.943174:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550016 00000100:00100000:0.0:1789049928.943237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789049928.943245:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a1887a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714550016:12345-0@lo:502: 00000100:00100000:0.0:1789049928.943409:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a1887a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714550016:12345-0@lo:502: Request processed in 165us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.943417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789049928.945621:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a1e49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714550016:0@lo:502: 00000040:00080000:2.0:1789049928.945755:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789049928.945771:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789049928.948238:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789049928.948288:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000eb659ca9) 00000020:00000080:3.0:1789049928.948313:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789049928.948400:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000481b350d from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789049928.948404:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000481b350d from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789049928.948407:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000481b350d 3 00010000:00080000:3.0:1789049928.948444:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000082f4cdad@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789049928.950163:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789049928.950672:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789049928.950724:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789049928.950741:0:7468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x3b8ec5973df5705e 00000100:00080000:3.0:1789049928.950755:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049928.950767:0:7468:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000082f4cdad using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049928.951420:0:7468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000bbfb452 x1875954714550144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049928.951444:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789049928.952288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bbfb452 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714550144:0@lo:38: 00000100:00100000:2.0:1789049928.952377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789049928.952602:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789049928.952655:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789049928.952688:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049928.952705:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049928.952716:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 0000000032fed865/0x3b8ec5973df57049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789049928.952769:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789049928.952772:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789049928.952773:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049928.952775:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049928.952776:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049928.952777:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049928.952779:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789049928.952780:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049928.952782:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049928.952783:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049928.952785:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049928.952788:0:7448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789049928.952791:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049928.952793:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789049928.952794:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049928.952795:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049928.952796:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049928.952797:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049928.952798:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789049928.952799:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049928.952800:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049928.952801:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049928.952802:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049928.952823:0:7448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789049928.952834:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cbb74ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714550272:0@lo:253: 00000100:00100000:0.0:1789049928.952873:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049928.952890:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012c3b854 going to sleep for 11 seconds 00000100:00100000:0.0:1789049928.952916:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550272 00000100:00100000:0.0:1789049928.952924:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550272 00000100:00100000:0.0:1789049928.952987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789049928.952994:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017a3ea63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714550272:12345-0@lo:253: 20000000:01000000:0.0:1789049928.953020:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789049928.953033:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789049928.953205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550144 00000100:00100000:3.0:1789049928.953210:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550144 00000100:00100000:3.0:1789049928.953233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049928.953247:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d02a1e49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714550144:12345-0@lo:38: 40000000:00080000:2.0:1789049928.956760:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:3.0:1789049928.959027:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1789049928.959079:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3b8ec5973df57065 00000004:00100000:3.0:1789049928.959096:0:6518:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789049928.959131:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000f8007b93 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049928.959222:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d02a1e49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875954714550144:12345-0@lo:38: Request processed in 5973us (6845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049928.959233:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789049928.962467:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000bbfb452 x1875954714550144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049928.962482:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049928.962495:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789049928.962504:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789049928.962510:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049928.962528:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000082f4cdad lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789049928.962535:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bbfb452 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714550144:0@lo:38: 00000001:00100000:3.0:1789049928.969089:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789049928.969204:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049928.969220:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789049928.969459:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789049928.969464:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789049928.969495:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969514:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969522:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969528:0:6534:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969564:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969578:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 15 pid: 6510 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.969592:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714550400:0@lo:104: 00000100:00100000:0.0:1789049928.969611:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017a3ea63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7448:x1875954714550272:12345-0@lo:253: Request processed in 16615us (16735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049928.969623:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789049928.969655:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049928.969706:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.969714:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 14 pid: 6512 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049928.969723:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e52f9a39 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714550528:0@lo:104: 00000100:00100000:2.0:1789049928.969727:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550400 00000100:00100000:2.0:1789049928.969738:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550400 00000100:00100000:3.0:1789049928.969744:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049928.969763:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d456e713 going to sleep for 11 seconds 00000100:00100000:2.0:1789049928.969775:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550528 00000100:00100000:2.0:1789049928.969780:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550528 00000100:00100000:2.0:1789049928.969797:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049928.969805:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e5bf761 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714550400:12345-0@lo:104: 00010000:00010000:2.0:1789049928.969818:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.969879:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049928.969885:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e5bf761 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714550400:12345-0@lo:104: Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.969891:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049928.969904:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049928.969909:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c42ab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714550528:12345-0@lo:104: 00010000:00010000:2.0:1789049928.969916:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.969967:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049928.969971:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c42ab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714550528:12345-0@lo:104: Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.969976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789049928.969992:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049928.969997:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970016:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e01fdc1 already unused, calling callback (0000000023d56a7f) 10000000:00010000:2.0:1789049928.970019:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970026:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049928.970033:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049928.970038:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789049928.970069:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714550400:0@lo:104: 00010000:00010000:2.0:1789049928.970070:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970081:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789049928.970084:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e52f9a39 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714550528:0@lo:104: 00010000:00010000:2.0:1789049928.970101:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049928.970106:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970113:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5702d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57034 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970131:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049928.970134:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970140:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046bcbfe9 already unused, calling callback (0000000023d56a7f) 10000000:00010000:2.0:1789049928.970141:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970157:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049928.970163:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049928.970168:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049928.970181:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970186:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049928.970212:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970219:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 0000000046bcbfe9/0x3b8ec5973df56f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.970233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049928.970235:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049928.970236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049928.970242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049928.970377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714550784:0@lo:103: 00000100:00100000:3.0:1789049928.970409:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.972348:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000316edd88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714550656:0@lo:103: 00000100:00100000:2.0:1789049928.972417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049928.972494:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550784 00000100:00100000:2.0:1789049928.972502:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550784 00010000:00010000:2.0:1789049928.972532:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 15 pid: 6512 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.972560:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550656 00000100:00100000:2.0:1789049928.972573:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550656 00010000:00010000:2.0:1789049928.972584:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 16 pid: 6510 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049928.972600:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049928.972607:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e52f9a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+16:3646:x1875954714550784:12345-0@lo:103: 00010000:00010000:2.0:1789049928.972620:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049928.972623:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 16 pid: 6512 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972631:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 16 pid: 6512 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972645:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0546970/0x3b8ec5973df56f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56f85 expref: 16 pid: 6512 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972659:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049928.972693:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e52f9a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714550784:12345-0@lo:103: Request processed in 87us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.972699:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049928.972713:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049928.972718:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cdbeb02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+14:3645:x1875954714550656:12345-0@lo:103: 00010000:00010000:2.0:1789049928.972725:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049928.972727:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 14 pid: 6510 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972735:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 14 pid: 6510 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972743:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bf50f33a/0x3b8ec5973df57034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5702d expref: 14 pid: 6510 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972759:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972767:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789049928.972784:0:7461:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008786538s 00010000:00010000:2.0:1789049928.972788:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972795:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972801:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972807:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972813:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c768b9d already unused, calling callback (00000000ff6fa21f) 00010000:00010000:2.0:1789049928.972816:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972823:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972838:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.972848:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049928.972878:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cdbeb02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+13:3645:x1875954714550656:12345-0@lo:103: Request processed in 160us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049928.972884:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049928.972983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000413f6f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714550784:0@lo:103: 00000100:00100000:2.0:1789049928.973030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000316edd88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714550656:0@lo:103: 00010000:00010000:2.0:1789049928.973044:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.973052:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049928.973058:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c768b9d/0x3b8ec5973df5706c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049928.973436:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cbb74ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:7448:1875954714550272:0@lo:253: 10000000:01000000:1.0:1789049928.973450:0:7448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789049928.973453:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049928.973455:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789049928.973456:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049928.973458:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049928.973459:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049928.973460:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049928.973461:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789049928.973462:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049928.973464:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049928.973465:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049928.973466:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789049928.973481:0:7448:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789049928.983858:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.984713:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789049928.984928:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.986766:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789049928.987274:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.988293:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789049928.998033:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.998315:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789049928.998509:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.998699:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789049928.998879:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789049928.999250:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789049929.001828:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789049929.002455:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789049929.002464:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789049929.002606:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789049929.002775:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000316edd88 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875954714550912:0@lo:700: 00000100:00100000:2.0:1789049929.002844:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049929.002900:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f342138 going to sleep for 11 seconds 00000100:00100000:3.0:1789049929.002979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714550912 00000100:00100000:3.0:1789049929.002988:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714550912 00000100:00100000:3.0:1789049929.003037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049929.003044:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000413f6f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875954714550912:12345-0@lo:700: 00000040:01000000:0.0:1789049929.003476:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789049929.003978:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551040:0@lo:1000: 00000100:00100000:2.0:1789049929.004020:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049929.004080:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090d89b6b going to sleep for 11 seconds 00000040:01000000:0.0:1789049929.004645:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789049929.004751:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789049929.005492:0:7448:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789049929.005501:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789049929.005648:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049929.006486:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551040 00000100:00100000:3.0:1789049929.006498:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551040 00000100:00100000:3.0:1789049929.006593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049929.006602:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a079595 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551040:12345-0@lo:1000: 00000100:00100000:3.0:1789049929.006736:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a079595 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551040:12345-0@lo:1000: Request processed in 135us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049929.006742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1789049929.007151:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789049929.007665:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789049929.007696:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1789049929.008536:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551040:0@lo:1000: 00000040:01000000:2.0:1789049929.008582:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789049929.008626:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551168:0@lo:700: 00000100:00100000:2.0:1789049929.008684:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049929.008718:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090d89b6b going to sleep for 11 seconds 00000040:00080000:0.0:1789049929.008875:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049929.009290:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551168 00000100:00100000:2.0:1789049929.009299:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551168 00000100:00100000:2.0:1789049929.009360:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049929.009367:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054facbc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551168:12345-0@lo:700: 00000100:00100000:2.0:1789049929.009443:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054facbc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551168:12345-0@lo:700: Request processed in 76us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049929.009449:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049929.009479:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551168:0@lo:700: 00000100:00100000:2.0:1789049929.009534:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875954714551296:0@lo:900: 00000100:00100000:2.0:1789049929.009562:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049929.009589:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090d89b6b going to sleep for 11 seconds 00080000:10000000:0.0:1789049929.009832:0:7448:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789049929.010858:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789049929.011104:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789049929.011326:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789049929.012628:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789049929.012805:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:3.0:1789049929.013333:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551296 00000100:00100000:3.0:1789049929.013346:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551296 00100000:10000000:0.0:1789049929.013599:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789049929.013885:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789049929.014049:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789049929.014296:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:3.0:1789049929.014430:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049929.014443:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f0965ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875954714551296:12345-0@lo:900: 00000100:00100000:3.0:1789049929.014538:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f0965ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875954714551296:12345-0@lo:900: Request processed in 100us (4977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049929.014546:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789049929.014613:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fa384742 x1875954714551296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789049945 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049929.014629:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa384742 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875954714551296:0@lo:900: 00000100:00100000:3.0:1789049929.014738:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551424:0@lo:1000: 00000100:00100000:3.0:1789049929.014788:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049929.014819:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551424 00000100:00100000:3.0:1789049929.014825:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551424 00000100:00100000:3.0:1789049929.014852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049929.014858:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c90e2249 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551424:12345-0@lo:1000: 00000100:00100000:3.0:1789049929.014913:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c90e2249 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551424:12345-0@lo:1000: Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049929.014919:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049929.014953:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007a8a835 going to sleep for 11 seconds 00000100:00100000:3.0:1789049929.014966:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551424:0@lo:1000: 00000004:00080000:3.0:1789049929.015004:0:7475:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d456e713 with version 0 00000020:00100000:3.0:1789049929.015018:0:7475:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789049929.015024:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003c26a9cf x1875954714551680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789049929.015034:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551680:0@lo:1000: 00000100:00100000:3.0:1789049929.015064:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049929.015083:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551680 00000100:00100000:3.0:1789049929.015087:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551680 00000100:00100000:3.0:1789049929.015108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049929.015113:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025513d6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551680:12345-0@lo:1000: 00100000:10000000:0.0:1789049929.015427:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789049929.015604:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789049929.015777:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789049929.015923:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789049929.016075:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789049929.016346:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789049929.016544:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789049929.016858:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789049929.017004:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789049929.017129:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789049929.017628:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789049929.017782:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789049929.017913:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789049929.018080:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789049929.018350:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789049929.018687:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789049929.018820:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000100:00100000:2.0:1789049929.019014:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a038391d going to sleep for 11 seconds 00100000:10000000:0.0:1789049929.019077:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789049929.019216:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789049929.019347:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789049929.019470:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789049929.019619:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789049929.019741:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789049929.019915:0:7448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:2.0:1789049929.022341:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1789049929.028204:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000413f6f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875954714550912:12345-0@lo:700: Request processed in 25154us (25354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049929.028226:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789049929.028406:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000316edd88 x1875954714550912/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049945 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049929.028423:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000316edd88 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875954714550912:0@lo:700: 40000000:02000000:3.0:1789049929.028438:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1789049929.035789:0:7448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789049929.035833:0:7448:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaeaec199f988 00100000:10000000:1.0:1789049929.035841:0:7448:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789049929.036516:0:7448:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789049929.036547:0:7448:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789049929.036568:0:7448:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789049929.036583:0:7448:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789049929.037420:0:7448:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789049929.037616:0:7448:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1789049929.047496:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1789049929.047635:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025513d6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551680:12345-0@lo:1000: Request processed in 32517us (32565us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789049929.047649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789049929.051215:0:7475:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789049929.051224:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789049929.051245:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c26a9cf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551680:0@lo:1000: 00000100:00100000:0.0:1789049929.051367:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a489e84a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551808:0@lo:1000: 00000100:00100000:0.0:1789049929.051435:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049929.051497:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be282d32 going to sleep for 11 seconds 00000100:00100000:3.0:1789049929.052111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714551808 00000100:00100000:3.0:1789049929.052120:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714551808 00000100:00100000:0.0:1789049929.052424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049929.052436:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e07f549e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551808:12345-0@lo:1000: 00000100:00100000:0.0:1789049929.052539:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e07f549e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875954714551808:12345-0@lo:1000: Request processed in 106us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049929.052548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049929.056021:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a489e84a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875954714551808:0@lo:1000: 00000040:00080000:3.0:1789049929.056061:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789049929.056105:0:7475:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006a0797b1 with version 1 00000004:00080000:1.0:1789049929.057511:0:7465:0:(osp_trans.c:1359:osp_get_next_request()) ou 000000001bb553fe version 1 rpc_version 1 00000020:00100000:1.0:1789049929.057548:0:7465:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789049929.057557:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000049f21661 x1875954714552064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789049929.057578:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f21661 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875954714552064:0@lo:1000: 00000100:00100000:1.0:1789049929.057648:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049929.057695:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b9a4ffe going to sleep for 11 seconds 00000100:00100000:1.0:1789049929.057719:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552064 00000100:00100000:1.0:1789049929.057726:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552064 00000100:00100000:1.0:1789049929.057776:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049929.057784:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025319b4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875954714552064:12345-0@lo:1000: 00000040:00080000:3.0:1789049929.060646:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789049929.060732:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1789049929.066910:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789049929.069365:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025319b4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875954714552064:12345-0@lo:1000: Request processed in 11575us (11710us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789049929.069380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789049929.069394:0:7465:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789049929.069400:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789049929.069419:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f21661 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875954714552064:0@lo:1000: 00000040:00080000:3.0:1789049929.077674:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049929.088626:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789049929.088705:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789049929.088711:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1789049929.834759:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049930.857156:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049931.881610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049932.905495:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049933.004010:0:7719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049933.930405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049933.930420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714552192:0@lo:41: 00000100:00100000:3.0:1789049933.930493:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049933.930617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552192 00000100:00100000:0.0:1789049933.930626:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552192 00000100:00100000:0.0:1789049933.930687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049933.930696:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4050866 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714552192:12345-0@lo:41: 00000004:00000024:0.0:1789049933.930744:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789049933.930807:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4050866 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714552192:12345-0@lo:41: Request processed in 113us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049933.930815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049933.930862:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714552192:0@lo:41: 00000020:00000004:0.0:1789049933.958635:0:7772:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789049933.958924:0:7772:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789049934.444787:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789049934.444796:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baab0ea0000 from 4 10000000:01000000:1.0:1789049934.444809:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049934.444859:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.444873:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.444883:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049934.444908:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099fb7b68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552320:0@lo:101: 00000100:00100000:1.0:1789049934.445000:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.445052:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085012434 going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.445075:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552320 00000100:00100000:1.0:1789049934.445083:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552320 00000100:00100000:1.0:1789049934.445141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789049934.445151:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000013b0f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+13:6515:x1875954714552320:12345-0@lo:101: 00010000:00010000:1.0:1789049934.445166:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049934.445179:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5301538/0x3b8ec5973df5707a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57073 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.445204:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5301538/0x3b8ec5973df5707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.445214:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5301538/0x3b8ec5973df5707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.445234:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5301538, rc 0) 00000100:00100000:1.0:1789049934.445281:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000013b0f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:6515:x1875954714552320:12345-0@lo:101: Request processed in 132us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.445296:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789049934.445304:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099fb7b68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552320:0@lo:101: 00010000:00010000:0.0:1789049934.445319:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.445328:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049934.445379:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6709ecb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552448:0@lo:256: 00000100:00100000:0.0:1789049934.445411:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.445432:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fcf4928 going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.445835:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714552704:0@lo:400: 00000100:00100000:3.0:1789049934.445872:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.445905:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049934.445911:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714552576:0@lo:400: 00000100:00100000:3.0:1789049934.445967:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.445994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552704 00000100:00100000:3.0:1789049934.445998:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552704 00000100:00100000:3.0:1789049934.446030:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552576 00000100:00100000:3.0:1789049934.446033:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552576 00000100:00100000:3.0:1789049934.446049:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049934.446055:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c26a9cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714552704:12345-0@lo:400: 00000100:00100000:3.0:1789049934.446095:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c26a9cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714552704:12345-0@lo:400: Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.446102:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049934.446116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049934.446122:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e52f9a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714552576:12345-0@lo:400: 00000100:00100000:3.0:1789049934.446147:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e52f9a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714552576:12345-0@lo:400: Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.446153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789049934.446183:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eec4785e x1875954714552576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049934.446194:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714552576:0@lo:400: 00010000:00080000:3.0:1789049934.446230:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fe3b242c x1875954714552704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049934.446238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714552704:0@lo:400: 00000100:00100000:1.0:1789049934.446793:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552448 00000100:00100000:1.0:1789049934.446800:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552448 00000100:00100000:1.0:1789049934.446835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789049934.446841:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009dee1dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:6515:x1875954714552448:12345-0@lo:256: 20000000:01000000:1.0:1789049934.446854:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049934.446870:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049934.446874:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789049934.446975:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009dee1dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:6515:x1875954714552448:12345-0@lo:256: Request processed in 135us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.446982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789049934.447462:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6709ecb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552448:0@lo:256: 10000000:01000000:3.0:1789049934.447512:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049934.447519:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.447529:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000c65bbdac/0x3b8ec5973df57073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049934.447539:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789049934.447541:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac606800 from 21 10000000:01000000:3.0:1789049934.447544:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049934.447570:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.447576:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.447584:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.447600:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552832:0@lo:101: 00000100:00100000:3.0:1789049934.447633:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.448498:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552832 00000100:00100000:1.0:1789049934.448508:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552832 00000100:00100000:1.0:1789049934.448554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789049934.448561:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d26a604b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:6515:x1875954714552832:12345-0@lo:101: 00010000:00010000:1.0:1789049934.448576:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049934.448591:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7dbd2c4/0x3b8ec5973df57088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57081 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.448616:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7dbd2c4/0x3b8ec5973df57088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.448625:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7dbd2c4/0x3b8ec5973df57088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.448634:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7dbd2c4, rc 0) 00000100:00100000:3.0:1789049934.448780:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3a463fa going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.449243:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d26a604b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714552832:12345-0@lo:101: Request processed in 681us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.449261:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789049934.449570:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552832:0@lo:101: 00010000:00010000:3.0:1789049934.449590:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.449607:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.449755:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552960:0@lo:501: 00000100:00100000:3.0:1789049934.449795:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.449866:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3a463fa going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.449962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714552960 00000100:00100000:1.0:1789049934.449968:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714552960 00000100:00100000:1.0:1789049934.450002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049934.450009:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020bfc9e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714552960:12345-0@lo:501: 00000100:00100000:1.0:1789049934.450129:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020bfc9e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714552960:12345-0@lo:501: Request processed in 121us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.450136:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049934.450208:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714552960:0@lo:501: 00000100:00100000:3.0:1789049934.450247:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553088:0@lo:503: 00000100:00100000:3.0:1789049934.450284:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.450311:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3a463fa going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.450366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553088 00000100:00100000:1.0:1789049934.450370:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553088 00000100:00100000:1.0:1789049934.450397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789049934.450402:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f0c5115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714553088:12345-0@lo:503: 00000100:00100000:1.0:1789049934.450477:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f0c5115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714553088:12345-0@lo:503: Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.450483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789049934.450520:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe3b242c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553088:0@lo:503: 00000100:00100000:1.0:1789049934.450727:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7797:1875954714553216:0@lo:502: 00000100:00100000:1.0:1789049934.450758:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.450770:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078bd6d08 going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.450960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553216 00000100:00100000:3.0:1789049934.450965:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553216 00000100:00100000:3.0:1789049934.450996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789049934.451003:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f16a1aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7797:x1875954714553216:12345-0@lo:502: 00000100:00100000:3.0:1789049934.451086:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f16a1aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7797:x1875954714553216:12345-0@lo:502: Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.451092:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049934.451182:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7797:1875954714553216:0@lo:502: 00000100:00100000:1.0:1789049934.451233:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7797:1875954714553344:0@lo:502: 00000100:00100000:1.0:1789049934.451265:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.451292:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078bd6d08 going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.451352:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553344 00000100:00100000:3.0:1789049934.451357:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553344 00000100:00100000:3.0:1789049934.451387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789049934.451393:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003cc88b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7797:x1875954714553344:12345-0@lo:502: 00000100:00100000:3.0:1789049934.451456:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003cc88b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:7797:x1875954714553344:12345-0@lo:502: Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.451464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049934.451597:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7797:1875954714553344:0@lo:502: 00000040:00080000:1.0:1789049934.451627:0:7797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789049934.451852:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789049934.451882:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049934.451890:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.451901:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000002c877b9c/0x3b8ec5973df57081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049934.451911:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789049934.451914:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baaac606800 from 4 10000000:01000000:3.0:1789049934.451917:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049934.451990:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.451998:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.452007:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.452021:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553472:0@lo:101: 00000100:00100000:3.0:1789049934.452053:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.452073:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f5c96eb going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.452134:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553472 00000100:00100000:1.0:1789049934.452139:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553472 00000100:00100000:1.0:1789049934.452174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789049934.452181:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b759357 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714553472:12345-0@lo:101: 00010000:00010000:1.0:1789049934.452191:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049934.452202:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df57096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5708f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.452232:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df57096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.452241:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d475ce9b/0x3b8ec5973df57096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.452249:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d475ce9b, rc 0) 00000100:00100000:1.0:1789049934.452275:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b759357 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714553472:12345-0@lo:101: Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.452281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789049934.452336:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553472:0@lo:101: 00010000:00010000:3.0:1789049934.452417:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.452426:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.452473:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553600:0@lo:256: 00000100:00100000:3.0:1789049934.452506:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.452527:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f5c96eb going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.452538:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553600 00000100:00100000:3.0:1789049934.452541:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553600 00000100:00100000:3.0:1789049934.452560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789049934.452565:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000140ff09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714553600:12345-0@lo:256: 20000000:01000000:3.0:1789049934.452576:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789049934.452592:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789049934.452594:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789049934.452734:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000140ff09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714553600:12345-0@lo:256: Request processed in 168us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.452741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789049934.452769:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553600:0@lo:256: 10000000:01000000:3.0:1789049934.452807:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049934.452812:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.452818:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000006c768b9d/0x3b8ec5973df5708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049934.452825:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789049934.452827:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789049934.452829:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049934.452844:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.452850:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.452867:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.452877:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553728:0@lo:101: 00000100:00100000:3.0:1789049934.452901:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.452915:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f5c96eb going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.452925:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553728 00000100:00100000:3.0:1789049934.452928:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553728 00000100:00100000:3.0:1789049934.452984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049934.452990:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007c2a205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714553728:12345-0@lo:101: 00010000:00010000:3.0:1789049934.452997:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049934.453016:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097222bc4/0x3b8ec5973df570a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5709d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.453032:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097222bc4/0x3b8ec5973df570a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.453040:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097222bc4/0x3b8ec5973df570a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.453046:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097222bc4, rc 0) 00000100:00100000:3.0:1789049934.453073:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007c2a205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714553728:12345-0@lo:101: Request processed in 84us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.453080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049934.453113:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553728:0@lo:101: 00010000:00010000:3.0:1789049934.453122:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049934.453142:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049934.453190:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553856:0@lo:501: 00000100:00100000:3.0:1789049934.453213:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.453243:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f5c96eb going to sleep for 11 seconds 00000100:00100000:3.0:1789049934.453252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553856 00000100:00100000:3.0:1789049934.453256:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553856 00000100:00100000:3.0:1789049934.453271:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789049934.453276:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ca570ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714553856:12345-0@lo:501: 00000100:00100000:3.0:1789049934.453550:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ca570ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714553856:12345-0@lo:501: Request processed in 274us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.453557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049934.456287:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec4785e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553856:0@lo:501: 00000100:00100000:1.0:1789049934.456485:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553984:0@lo:503: 00000100:00100000:1.0:1789049934.456561:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.456599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714553984 00000100:00100000:1.0:1789049934.456606:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714553984 00000100:00100000:1.0:1789049934.457456:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049934.457467:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc44f0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714553984:12345-0@lo:503: 00000100:00100000:1.0:1789049934.457597:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc44f0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714553984:12345-0@lo:503: Request processed in 132us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.457610:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049934.458307:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c79bdc11 going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.458333:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714553984:0@lo:503: 00000100:00100000:1.0:1789049934.458614:0:7798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7798:1875954714554112:0@lo:502: 00000100:00100000:1.0:1789049934.458804:0:7798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.458865:0:7798:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f5c13d6 going to sleep for 11 seconds 00000100:00100000:2.0:1789049934.464775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554112 00000100:00100000:2.0:1789049934.464790:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554112 00000100:00100000:2.0:1789049934.464845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789049934.464854:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a006e26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:7798:x1875954714554112:12345-0@lo:502: 00000100:00100000:2.0:1789049934.465053:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a006e26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:7798:x1875954714554112:12345-0@lo:502: Request processed in 200us (6250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.465061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049934.465596:0:7798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7798:1875954714554112:0@lo:502: 00000020:01000000:1.0:1789049934.465634:0:7798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049934.465929:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049934.465934:0:7798:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789049934.465968:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789049934.465972:0:7798:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:00000080:1.0:1789049934.466000:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049934.466015:0:7798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000fa7c876a) 00000020:00000080:1.0:1789049934.466038:0:7798:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789049934.466044:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789049934.466146:0:7798:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789049934.466152:0:7798:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789049934.466159:0:7798:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df570b2 00010000:00080000:1.0:1789049934.466189:0:7798:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001984a186@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789049934.470591:0:7798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789049934.473051:0:7798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789049934.473068:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789049934.473107:0:7798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789049934.473144:0:7798:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df570b9 00000100:00080000:1.0:1789049934.473157:0:7798:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049934.473170:0:7798:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000001984a186 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789049934.473209:0:7798:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005cfdd8bf x1875954714554240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789049934.473279:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714554240:0@lo:38: 00000100:00100000:2.0:1789049934.473366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.473525:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554240 00000100:00100000:0.0:1789049934.473534:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554240 00000100:00100000:0.0:1789049934.473569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049934.473575:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000fbc7b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714554240:12345-0@lo:38: 00010000:00080000:0.0:1789049934.473602:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1789049934.473634:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df570c0 00000004:00100000:0.0:1789049934.473650:0:6524:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789049934.473657:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789049934.474455:0:7798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789049934.474513:0:7798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789049934.475834:0:7801:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ebfb877c x1875954714554368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049934.475849:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 000000004082e057 going to sleep for 0 seconds 00000020:01000000:0.0:1789049934.476264:0:7798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049934.476272:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049934.476275:0:7798:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789049934.476278:0:7798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049934.476282:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049934.476284:0:7798:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049934.476287:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049934.476288:0:7798:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789049934.476314:0:7798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7798:1875954714554496:0@lo:502: 00000100:00100000:0.0:1789049934.476402:0:7798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.476453:0:7798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c555f02f going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.476745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554496 00000100:00100000:1.0:1789049934.476754:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554496 00000100:00100000:1.0:1789049934.476815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049934.476825:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b20ca251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:7798:x1875954714554496:12345-0@lo:502: 00000100:00100000:1.0:1789049934.476977:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b20ca251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:7798:x1875954714554496:12345-0@lo:502: Request processed in 154us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049934.476985:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049934.477212:0:7798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:7798:1875954714554496:0@lo:502: 00000020:01000000:0.0:1789049934.477253:0:7798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049934.477258:0:7798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049934.477260:0:7798:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789049934.477264:0:7798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789049934.477437:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789049934.477463:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789049934.477471:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.477483:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000005e01fdc1/0x3b8ec5973df5709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049934.477492:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789049934.477494:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857ab380 from 1 10000000:01000000:1.0:1789049934.477497:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789049934.477525:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.477532:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049934.477553:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049934.477567:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714554624:0@lo:101: 00000100:00100000:1.0:1789049934.477733:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.477770:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9dbe255 going to sleep for 11 seconds 00000100:00100000:0.0:1789049934.477984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554624 00000100:00100000:0.0:1789049934.477991:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554624 00000100:00100000:0.0:1789049934.478029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049934.478036:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dee16b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714554624:12345-0@lo:101: 00010000:00010000:0.0:1789049934.478048:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049934.478058:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e56a747b/0x3b8ec5973df570ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df570c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.478080:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e56a747b/0x3b8ec5973df570ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.478089:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e56a747b/0x3b8ec5973df570ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.478097:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e56a747b, rc 0) 00000100:00100000:0.0:1789049934.478133:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dee16b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714554624:12345-0@lo:101: Request processed in 98us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049934.478140:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049934.478251:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000761a2ca3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714554624:0@lo:101: 00010000:00010000:0.0:1789049934.478263:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.478283:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049934.478340:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714554752:0@lo:501: 00000100:00100000:0.0:1789049934.478365:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.478388:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000821c3d23 going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.478434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554752 00000100:00100000:1.0:1789049934.478440:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554752 00000100:00100000:1.0:1789049934.478472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789049934.478479:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004c18251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714554752:12345-0@lo:501: 00000100:00100000:1.0:1789049934.478554:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004c18251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714554752:12345-0@lo:501: Request processed in 75us (188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049934.478561:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789049934.479002:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714554752:0@lo:501: 10000000:01000000:0.0:1789049934.479030:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789049934.479036:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049934.479043:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000eca48ef5/0x3b8ec5973df570c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789049934.482831:0:6524:0:(import.c:65:import_set_state_nolock()) 000000002751aff4 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049934.482966:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000fbc7b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875954714554240:12345-0@lo:38: Request processed in 9360us (9571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049934.482978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049934.483077:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049934.483088:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789049934.483096:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789049934.483101:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789049934.483103:0:3643:0:(import.c:65:import_set_state_nolock()) 000000001984a186 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789049934.483126:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004082e057): req@00000000ebfb877c x1875954714554368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049934.483149:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cfdd8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714554240:0@lo:38: 00000100:00100000:3.0:1789049934.483305:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049934.483320:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ece2f882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714554880:0@lo:41: 00000100:00100000:3.0:1789049934.483496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.483609:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.484238:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 000000004082e057 going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.484269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554880 00000100:00100000:1.0:1789049934.484277:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554880 00000100:00100000:2.0:1789049934.484815:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714554368 00000100:00100000:2.0:1789049934.484821:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714554368 00000100:00100000:2.0:1789049934.484847:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049934.484855:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bbfb452 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714554880:12345-0@lo:41: 00000004:00000024:2.0:1789049934.484892:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789049934.484988:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bbfb452 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714554880:12345-0@lo:41: Request processed in 134us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.484995:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049934.485013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049934.485018:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ef0fe9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714554368:12345-0@lo:1000: 00000100:00100000:2.0:1789049934.485075:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ef0fe9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714554368:12345-0@lo:1000: Request processed in 58us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.485082:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049934.485137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ece2f882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714554880:0@lo:41: 00000100:00100000:3.0:1789049934.486310:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebfb877c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714554368:0@lo:1000: 00000040:01000000:3.0:1789049934.486425:0:7801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789049934.486477:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555008:0@lo:1000: 00000100:00100000:3.0:1789049934.486537:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.486576:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f5c96eb going to sleep for 11 seconds 00000100:00100000:2.0:1789049934.486631:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555008 00000100:00100000:2.0:1789049934.486639:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555008 00000100:00100000:2.0:1789049934.486691:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049934.486698:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000021c8d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555008:12345-0@lo:1000: 00000100:00100000:2.0:1789049934.486814:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000021c8d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555008:12345-0@lo:1000: Request processed in 116us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.486821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049934.489791:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555008:0@lo:1000: 00000100:00100000:3.0:1789049934.489869:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555136:0@lo:700: 00000100:00100000:3.0:1789049934.489922:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049934.489973:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a84c214b going to sleep for 11 seconds 00000100:00100000:2.0:1789049934.493285:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555136 00000100:00100000:2.0:1789049934.493301:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555136 00000100:00100000:2.0:1789049934.493475:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049934.493486:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019dba29e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555136:12345-0@lo:700: 00000100:00100000:2.0:1789049934.493597:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019dba29e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555136:12345-0@lo:700: Request processed in 114us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.493605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049934.493679:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018867b62 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555136:0@lo:700: 00000100:00100000:0.0:1789049934.493886:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555264:0@lo:1000: 00000100:00100000:0.0:1789049934.493925:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.493973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555264 00000100:00100000:0.0:1789049934.493978:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555264 00000100:00100000:0.0:1789049934.494006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049934.494012:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7396891 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555264:12345-0@lo:1000: 00000100:00100000:0.0:1789049934.494067:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7396891 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555264:12345-0@lo:1000: Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049934.494074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049934.494100:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c79bdc11 going to sleep for 11 seconds 00000100:00100000:0.0:1789049934.494119:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555264:0@lo:1000: 00000004:00080000:0.0:1789049934.497323:0:7801:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000821c3d23 with version 0 00000020:00100000:0.0:1789049934.497362:0:7801:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789049934.497372:0:7801:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b8bb7ffc x1875954714555520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049934.497396:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555520:0@lo:1000: 00000100:00100000:0.0:1789049934.497459:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049934.497490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555520 00000100:00100000:0.0:1789049934.497494:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007a8a835 going to sleep for 11 seconds 00000100:00100000:1.0:1789049934.497498:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555520 00000100:00100000:1.0:1789049934.497551:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049934.497559:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d15280d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7801:x1875954714555520:12345-0@lo:1000: 00000001:00080000:0.0:1789049934.502355:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789049934.502371:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789049934.502620:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d15280d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7801:x1875954714555520:12345-0@lo:1000: Request processed in 5058us (5157us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789049934.502634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1789049934.502781:0:7801:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789049934.502785:0:7801:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789049934.502799:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555520:0@lo:1000: 00000100:00100000:0.0:1789049934.502908:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555648:0@lo:1000: 00000100:00100000:0.0:1789049934.502975:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.503012:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 00000000163c6162 going to sleep for 11 seconds 00000100:00100000:2.0:1789049934.503069:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555648 00000100:00100000:2.0:1789049934.503077:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555648 00000100:00100000:2.0:1789049934.503124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049934.503133:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7801:x1875954714555648:12345-0@lo:1000: 00000100:00100000:2.0:1789049934.503206:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7801:x1875954714555648:12345-0@lo:1000: Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049934.503213:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049934.503276:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8bb7ffc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7801:1875954714555648:0@lo:1000: 00000040:00080000:0.0:1789049934.503291:0:7801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789049934.503316:0:7801:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000007a8a835 with version 1 00000004:00080000:2.0:1789049934.503419:0:7799:0:(osp_trans.c:1359:osp_get_next_request()) ou 000000004656f35a version 1 rpc_version 1 00000020:00100000:2.0:1789049934.503435:0:7799:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789049934.503442:0:7799:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001d5a9c62 x1875954714555904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789049934.503455:0:7799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d5a9c62 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7799:1875954714555904:0@lo:1000: 00000100:00100000:2.0:1789049934.503481:0:7799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049934.503496:0:7799:0:(client.c:2716:ptlrpc_set_wait()) set 000000001670a9b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789049934.503507:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714555904 00000100:00100000:2.0:1789049934.503517:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714555904 00000100:00100000:2.0:1789049934.503539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049934.503544:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cf2a175 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7799:x1875954714555904:12345-0@lo:1000: 00000040:00080000:0.0:1789049934.511531:0:7801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789049934.511614:0:7801:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789049934.511619:0:7801:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789049934.513542:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789049934.513851:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cf2a175 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7799:x1875954714555904:12345-0@lo:1000: Request processed in 10302us (10365us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789049934.513866:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789049934.513996:0:7799:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789049934.514002:0:7799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789049934.514021:0:7799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d5a9c62 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7799:1875954714555904:0@lo:1000: 00010000:00010000:2.0:1789049934.953498:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049935.977897:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789049936.688404:0:7878:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049936.688743:0:7878:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789049937.008514:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789049937.650713:0:7926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9ccb5b60 20000000:00000080:2.0:1789049937.650738:0:7926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baab4f76400 uarg=0000000000000000 20000000:01000000:2.0:1789049937.650790:0:7926:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789049937.650799:0:7926:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789049937.650805:0:7926:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789049937.650908:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789049937.650922:0:7926:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789049937.657499:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049937.657823:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789049937.657862:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789049937.657879:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789049937.657899:0:7926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789049937.657921:0:7926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658504:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658515:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658522:0:7926:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658585:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658603:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 17 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049937.658618:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1875954714556032:0@lo:104: 00000100:00100000:2.0:1789049937.658705:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049937.658776:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.658785:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049937.658792:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1875954714556160:0@lo:104: 00000100:00100000:2.0:1789049937.658811:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set 00000000447b18ef going to sleep for 11 seconds 00000100:00100000:3.0:1789049937.659745:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049937.659775:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049937.659816:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556032 00000100:00100000:3.0:1789049937.659825:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556032 00000100:00100000:3.0:1789049937.659867:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556160 00000100:00100000:3.0:1789049937.659869:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556160 00000100:00100000:3.0:1789049937.659883:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049937.659891:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3de074 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:7926:x1875954714556032:12345-0@lo:104: 00010000:00010000:3.0:1789049937.659908:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049937.660136:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049937.660141:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3de074 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:7926:x1875954714556032:12345-0@lo:104: Request processed in 252us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049937.660148:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049937.660188:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049937.660206:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab401460 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:7926:x1875954714556160:12345-0@lo:104: 00010000:00010000:3.0:1789049937.660213:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049937.660272:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789049937.660276:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab401460 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:7926:x1875954714556160:12345-0@lo:104: Request processed in 83us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049937.660283:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049937.660483:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1875954714556032:0@lo:104: 00000100:00100000:2.0:1789049937.660494:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1875954714556160:0@lo:104: 00010000:00010000:2.0:1789049937.660516:0:7926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660565:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049937.660571:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660578:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000138e5fb5 already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049937.660581:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660588:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049937.660594:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049937.660599:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049937.660638:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660644:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049937.660671:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660677:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000138e5fb5/0x3b8ec5973df5703b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57042 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660693:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049937.660695:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660700:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b822d4b5 already unused, calling callback (0000000023d56a7f) 10000000:00010000:1.0:1789049937.660709:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660715:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049937.660720:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049937.660725:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049937.660738:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660743:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049937.660756:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660761:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000b822d4b5/0x3b8ec5973df56f4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56f54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.660776:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049937.660778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049937.660858:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049937.660868:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049937.660882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e58be39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714556288:0@lo:103: 00000100:00100000:1.0:1789049937.660924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049937.661095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000981be852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714556416:0@lo:103: 00000100:00100000:1.0:1789049937.661120:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049937.661151:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556288 00000100:00100000:1.0:1789049937.661159:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556288 00010000:00010000:1.0:1789049937.661189:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 18 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049937.661229:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556416 00000100:00100000:1.0:1789049937.661231:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556416 00010000:00010000:1.0:1789049937.661242:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 19 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049937.661255:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049937.661261:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c137efa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+19:3646:x1875954714556288:12345-0@lo:103: 00010000:00010000:1.0:1789049937.661273:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049937.661277:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 19 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.661287:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 19 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.661300:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d6651c6/0x3b8ec5973df57042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5703b expref: 19 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.661312:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049937.663757:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049937.663850:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c137efa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+18:3646:x1875954714556288:12345-0@lo:103: Request processed in 2581us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049937.663866:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049937.663915:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049937.663931:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b578af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+17:3644:x1875954714556416:12345-0@lo:103: 00010000:00010000:1.0:1789049937.663970:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049937.663979:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664018:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664096:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000caf4015/0x3b8ec5973df56f54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56f4d expref: 17 pid: 6510 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664118:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664126:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664144:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664151:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664158:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664165:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664171:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd121f8a already unused, calling callback (00000000ff6fa21f) 00010000:00010000:1.0:1789049937.664176:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664183:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664216:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049937.664227:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049937.664273:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b578af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+16:3644:x1875954714556416:12345-0@lo:103: Request processed in 351us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049937.664280:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049937.664326:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000981be852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714556416:0@lo:103: 00000100:00100000:1.0:1789049937.664363:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e58be39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714556288:0@lo:103: 00010000:00010000:2.0:1789049937.665145:0:7926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.665170:0:7926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049937.665177:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd121f8a/0x3b8ec5973df570d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049938.025399:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049939.049098:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049939.049127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714556544:0@lo:41: 00000100:00100000:3.0:1789049939.049227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049939.049350:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556544 00000100:00100000:2.0:1789049939.049359:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556544 00000100:00100000:2.0:1789049939.049414:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049939.049423:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e5bf761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714556544:12345-0@lo:41: 00000004:00000024:2.0:1789049939.049463:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789049939.049515:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e5bf761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714556544:12345-0@lo:41: Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049939.049522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049939.049702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714556544:0@lo:41: 00010000:00010000:3.0:1789049939.053897:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049939.561194:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714556672:0@lo:41: 00000100:00100000:0.0:1789049939.561275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049939.561535:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556672 00000100:00100000:2.0:1789049939.561544:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556672 00000100:00100000:2.0:1789049939.561590:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049939.561598:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8bb7ffc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714556672:12345-0@lo:41: 00000004:00000024:2.0:1789049939.561650:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789049939.561697:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8bb7ffc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714556672:12345-0@lo:41: Request processed in 100us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049939.561704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049939.561728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714556928:0@lo:400: 00000100:00100000:2.0:1789049939.561764:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049939.561791:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049939.561797:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c9ea98d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714557056:0@lo:400: 00000100:00100000:2.0:1789049939.561817:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049939.561852:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556928 00000100:00100000:2.0:1789049939.561855:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556928 00000100:00100000:2.0:1789049939.561882:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557056 00000100:00100000:2.0:1789049939.561885:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557056 00000100:00100000:2.0:1789049939.561898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049939.561903:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000720e287f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714556928:12345-0@lo:400: 00000100:00100000:2.0:1789049939.561963:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000720e287f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714556928:12345-0@lo:400: Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049939.561970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049939.561982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049939.561987:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d48045d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714557056:12345-0@lo:400: 00000100:00100000:2.0:1789049939.562010:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d48045d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714557056:12345-0@lo:400: Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049939.562015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789049939.562051:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002c9ea98d x1875954714557056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049939.562064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c9ea98d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714557056:0@lo:400: 00010000:00080000:2.0:1789049939.562087:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009a990662 x1875954714556928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049939.562095:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a990662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714556928:0@lo:400: 00000100:00100000:2.0:1789049939.562123:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb5ad4fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714556672:0@lo:41: 00000100:00100000:2.0:1789049939.562131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049939.562136:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714556800:0@lo:400: 00000100:00100000:2.0:1789049939.562160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049939.562202:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714556800 00000100:00100000:2.0:1789049939.562206:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714556800 00000100:00100000:2.0:1789049939.562228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789049939.562232:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004078ef52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:3646:x1875954714556800:12345-0@lo:400: 00000100:00100000:2.0:1789049939.562261:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004078ef52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:3646:x1875954714556800:12345-0@lo:400: Request processed in 29us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049939.562266:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789049939.562302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3888541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714556800:0@lo:400: 00010000:00010000:1.0:1789049940.073058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049941.097798:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049942.123923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049943.146720:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049944.170118:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049944.170171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714557184:0@lo:41: 00000100:00100000:3.0:1789049944.170262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049944.170306:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557184 00000100:00100000:1.0:1789049944.170315:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557184 00000100:00100000:1.0:1789049944.170374:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049944.170384:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c42ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714557184:12345-0@lo:41: 00000004:00000024:1.0:1789049944.170420:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789049944.170486:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c42ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714557184:12345-0@lo:41: Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049944.170494:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789049944.170702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714557184:0@lo:41: 10000000:01000000:3.0:1789049944.171493:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049944.171505:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab0ea0000 from 1 10000000:01000000:3.0:1789049944.171509:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049944.171549:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000230bb4e8/0x3b8ec5973df570dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.171560:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000230bb4e8/0x3b8ec5973df570dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.171570:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000230bb4e8/0x3b8ec5973df570dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049944.171595:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557312:0@lo:101: 00000100:00100000:3.0:1789049944.171641:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.171680:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a36da76b going to sleep for 11 seconds 00000100:00100000:1.0:1789049944.172005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557312 00000100:00100000:1.0:1789049944.172013:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557312 00000100:00100000:1.0:1789049944.172062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789049944.172074:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044f6b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714557312:12345-0@lo:101: 00010000:00010000:1.0:1789049944.172089:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049944.172114:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e89f7bc/0x3b8ec5973df570e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df570dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.172145:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e89f7bc/0x3b8ec5973df570e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.172173:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e89f7bc/0x3b8ec5973df570e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.172188:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e89f7bc, rc 0) 00000100:00100000:1.0:1789049944.172245:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044f6b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557312:12345-0@lo:101: Request processed in 174us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049944.172251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789049944.172259:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557312:0@lo:101: 00010000:00010000:3.0:1789049944.172277:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000230bb4e8/0x3b8ec5973df570dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.172297:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000230bb4e8/0x3b8ec5973df570dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049944.172367:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557440:0@lo:501: 00000100:00100000:3.0:1789049944.172397:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.172417:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a36da76b going to sleep for 11 seconds 00000100:00100000:2.0:1789049944.173835:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557440 00000100:00100000:2.0:1789049944.173845:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557440 00000100:00100000:2.0:1789049944.173901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789049944.173911:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc18f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557440:12345-0@lo:501: 00000100:00100000:2.0:1789049944.174115:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc18f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557440:12345-0@lo:501: Request processed in 205us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049944.174129:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789049944.176075:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557440:0@lo:501: 00000100:00100000:3.0:1789049944.176173:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557568:0@lo:503: 00000100:00100000:3.0:1789049944.177110:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.177169:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a36da76b going to sleep for 11 seconds 00000100:00100000:3.0:1789049944.177206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557568 00000100:00100000:3.0:1789049944.177216:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557568 00000100:00100000:3.0:1789049944.177272:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049944.177292:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000077db44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557568:12345-0@lo:503: 00000100:00100000:3.0:1789049944.177434:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000077db44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557568:12345-0@lo:503: Request processed in 152us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.177446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049944.177522:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557568:0@lo:503: 00000100:00100000:3.0:1789049944.179721:0:8234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8234:1875954714557696:0@lo:502: 00000100:00100000:3.0:1789049944.179811:0:8234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.179860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557696 00000100:00100000:3.0:1789049944.179868:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557696 00000100:00100000:3.0:1789049944.179926:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049944.179954:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d030b0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:8234:x1875954714557696:12345-0@lo:502: 00000100:00100000:3.0:1789049944.180099:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d030b0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:8234:x1875954714557696:12345-0@lo:502: Request processed in 164us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.180109:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049944.180181:0:8234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5551fb6 going to sleep for 11 seconds 00000100:00100000:3.0:1789049944.180200:0:8234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fc09a38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8234:1875954714557696:0@lo:502: 00000020:01000000:3.0:1789049944.180231:0:8234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049944.180242:0:8234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049944.180244:0:8234:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049944.180253:0:8234:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baab0ea0000 00000020:00000080:3.0:1789049944.180255:0:8234:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049944.180374:0:8234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8234:1875954714557824:0@lo:502: 00000100:00100000:3.0:1789049944.180407:0:8234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.180432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557824 00000100:00100000:3.0:1789049944.180436:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557824 00000100:00100000:3.0:1789049944.180460:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789049944.180466:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:8234:x1875954714557824:12345-0@lo:502: 00000100:00100000:3.0:1789049944.181990:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:8234:x1875954714557824:12345-0@lo:502: Request processed in 1517us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.182007:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789049944.182089:0:8234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049944.182117:0:8234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8234:1875954714557824:0@lo:502: 00000020:01000000:3.0:1789049944.182163:0:8234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049944.182173:0:8234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049944.182177:0:8234:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789049944.182185:0:8234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789049944.185216:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789049944.185261:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049944.185274:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.185288:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049944.185301:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049944.185305:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac606800 from 1 10000000:01000000:1.0:1789049944.185308:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049944.185352:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.185362:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049944.185378:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049944.185421:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557952:0@lo:101: 00000100:00100000:1.0:1789049944.185509:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049944.185566:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049944.186566:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714557952 00000100:00100000:3.0:1789049944.186584:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714557952 00000100:00100000:3.0:1789049944.186654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789049944.186665:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714557952:12345-0@lo:101: 00010000:00010000:3.0:1789049944.186682:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049944.186701:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df570ea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.186732:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.186745:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.186756:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603a00, rc 0) 00000100:00100000:3.0:1789049944.186825:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714557952:12345-0@lo:101: Request processed in 161us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.186832:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789049944.186889:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714557952:0@lo:101: 00010000:00010000:3.0:1789049944.186921:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049944.186932:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049944.187230:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714558080:0@lo:501: 00000100:00100000:3.0:1789049944.187272:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.187308:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049944.187391:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558080 00000100:00100000:2.0:1789049944.187398:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558080 00000100:00100000:2.0:1789049944.187438:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789049944.187449:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714558080:12345-0@lo:501: 00000100:00100000:2.0:1789049944.187600:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714558080:12345-0@lo:501: Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049944.187616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789049944.187833:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714558080:0@lo:501: 00000100:00100000:3.0:1789049944.187880:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714558208:0@lo:503: 00000100:00100000:3.0:1789049944.187924:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.187981:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049944.188010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558208 00000100:00100000:2.0:1789049944.188015:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558208 00000100:00100000:2.0:1789049944.188051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049944.188060:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714558208:12345-0@lo:503: 00000100:00100000:2.0:1789049944.188162:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714558208:12345-0@lo:503: Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049944.188170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789049944.188244:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714558208:0@lo:503: 00000100:00100000:3.0:1789049944.189481:0:8236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8236:1875954714558336:0@lo:502: 00000100:00100000:3.0:1789049944.189687:0:8236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.189735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558336 00000100:00100000:3.0:1789049944.189744:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558336 00000100:00100000:3.0:1789049944.189790:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789049944.189803:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:8236:x1875954714558336:12345-0@lo:502: 00000100:00100000:3.0:1789049944.189920:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:8236:x1875954714558336:12345-0@lo:502: Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.190021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789049944.190081:0:8236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049944.190104:0:8236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8236:1875954714558336:0@lo:502: 00000020:01000000:3.0:1789049944.190139:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049944.190159:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049944.190163:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049944.190172:0:8236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baaac606800 00000020:00000080:3.0:1789049944.190175:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049944.190200:0:8236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8236:1875954714558464:0@lo:502: 00000100:00100000:3.0:1789049944.190237:0:8236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.190261:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558464 00000100:00100000:3.0:1789049944.190265:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558464 00000100:00100000:3.0:1789049944.191092:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789049944.191107:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8236:x1875954714558464:12345-0@lo:502: 00000100:00100000:3.0:1789049944.191235:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8236:x1875954714558464:12345-0@lo:502: Request processed in 132us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.191244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049944.192075:0:8236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049944.192108:0:8236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8236:1875954714558464:0@lo:502: 00000020:01000000:2.0:1789049944.192146:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049944.192165:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049944.192168:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789049944.192179:0:8236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789049944.192260:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789049944.192354:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049944.192368:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049944.192386:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049944.682213:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714558592:0@lo:41: 00000100:00100000:3.0:1789049944.682307:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049944.682390:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558592 00000100:00100000:3.0:1789049944.682399:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558592 00000100:00100000:3.0:1789049944.682444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049944.682452:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714558592:12345-0@lo:41: 00000004:00000024:3.0:1789049944.682500:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789049944.682543:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714558592:12345-0@lo:41: Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049944.682550:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049944.682598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714558592:0@lo:41: 00000100:00100000:2.0:1789049944.687031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714558720:0@lo:400: 00000100:00100000:2.0:1789049944.687126:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049944.687197:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049944.687203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714558848:0@lo:400: 00000100:00100000:2.0:1789049944.687225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049944.687260:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558720 00000100:00100000:2.0:1789049944.687268:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558720 00000100:00100000:2.0:1789049944.687328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558848 00000100:00100000:2.0:1789049944.687332:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558848 00000100:00100000:2.0:1789049944.687350:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049944.687360:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714558720:12345-0@lo:400: 00000100:00100000:2.0:1789049944.687416:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714558720:12345-0@lo:400: Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049944.687424:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049944.687443:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049944.687450:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714558848:12345-0@lo:400: 00000100:00100000:2.0:1789049944.687656:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714558848:12345-0@lo:400: Request processed in 206us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049944.687663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789049944.687732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baaa7d50a80 x1875954714558848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049944.687746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714558848:0@lo:400: 00010000:00080000:2.0:1789049944.687758:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baaa7d52a00 x1875954714558720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049944.687766:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714558720:0@lo:400: 00010000:00010000:1.0:1789049945.193047:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049946.223252:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049947.241046:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789049947.914783:0:8426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049947.914788:0:8426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789049947.914790:0:8426:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789049947.914973:0:8426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8baaac621000 00000020:01000004:3.0:1789049947.914991:0:8426:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789049947.915006:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789049947.915023:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8baab4e399c0) 00000020:00000080:3.0:1789049947.915041:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789049947.979686:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789049947.979750:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789049948.009750:0:8426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789049948.010022:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789049948.010037:0:8426:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789049948.010051:0:8426:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3b8ec5973df570ff 00000020:01000004:1.0:1789049948.010059:0:8426:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789049948.010086:0:8426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789049948.010090:0:8426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789049948.010097:0:8426:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789049948.010103:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789049948.010116:0:8426:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8baabd1799c0) 00000020:00000080:1.0:1789049948.010138:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789049948.014062:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049948.014447:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789049948.014455:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789049948.015502:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049948.015512:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789049948.016391:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789049948.016401:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789049948.021765:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049948.023356:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789049948.023366:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789049948.028093:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789049948.028391:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789049948.064386:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049948.064662:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049948.064670:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789049948.066135:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049948.066154:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789049948.068150:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049948.068167:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789049948.071204:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049948.071539:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789049948.071546:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789049948.072639:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789049948.072655:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789049948.121132:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049948.121496:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789049948.121503:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789049948.123167:0:8426:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789049948.123182:0:8426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789049948.124756:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789049948.124799:0:8426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789049948.124807:0:8426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789049948.171825:0:8426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789049948.171873:0:8426:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789049948.171878:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789049948.171880:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049948.171881:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049948.171882:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049948.171884:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049948.171886:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049948.171887:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049948.171889:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049948.171891:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049948.171893:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049948.171894:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049948.171899:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789049948.171901:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049948.171903:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049948.171904:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049948.171906:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049948.171907:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049948.171908:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049948.171909:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049948.171910:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049948.171911:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049948.171912:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049948.171913:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049948.171979:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789049948.172004:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714558976:0@lo:253: 00000100:00100000:2.0:1789049948.172173:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.172260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714558976 00000100:00100000:0.0:1789049948.172277:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714558976 00000100:00100000:2.0:1789049948.172308:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87571480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.177788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789049948.177811:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8426:x1875954714558976:12345-0@lo:253: 20000000:01000000:3.0:1789049948.177860:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789049948.177865:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789049948.177870:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789049948.177873:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789049948.178222:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049948.178392:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789049948.178422:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789049948.178443:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789049948.178450:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789049948.178465:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789049948.178482:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789049948.178608:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789049948.178625:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:3.0:1789049948.178627:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789049948.178643:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789049948.178649:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789049948.178678:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789049948.178687:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789049948.178700:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789049948.178707:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789049948.178719:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789049948.178735:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789049948.178805:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789049948.178817:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:3.0:1789049948.178819:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789049948.178832:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789049948.178844:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789049948.178858:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789049948.178862:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789049948.178874:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789049948.178879:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789049948.178891:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789049948.178907:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789049948.179300:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789049948.179313:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:3.0:1789049948.179315:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789049948.179331:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789049948.179338:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789049948.179352:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789049948.179357:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789049948.179371:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789049948.179377:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789049948.179390:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789049948.179404:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789049948.179417:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789049948.179420:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789049948.179423:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789049948.179465:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789049948.179468:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789049948.180085:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789049948.180114:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789049948.180147:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789049948.180384:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789049948.180421:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789049948.180439:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789049948.180452:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049948.180455:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049948.181184:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049948.181217:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049948.181233:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789049948.181450:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789049948.181485:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789049948.181502:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789049948.181511:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789049948.181513:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049948.183512:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049948.183580:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049948.183598:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789049948.183825:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789049948.183848:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789049948.183863:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1789049948.183876:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789049948.183879:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789049948.184359:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789049948.184495:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789049948.184516:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789049948.184542:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1789049948.184560:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049948.184583:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184604:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184611:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184618:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184624:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184631:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184638:0:6510:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184704:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184721:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 18 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.184737:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559104:0@lo:104: 00000100:00100000:2.0:1789049948.184818:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049948.184877:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.184885:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 18 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.184893:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559232:0@lo:104: 00000100:00100000:2.0:1789049948.184915:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049948.184995:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.185006:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 18 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.185016:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559360:0@lo:104: 00000100:00100000:0.0:1789049948.185036:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559104 00000100:00100000:2.0:1789049948.185044:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.185050:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559104 00010000:00010000:2.0:1789049948.185067:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.185079:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 18 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185100:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559232 00000100:00100000:2.0:1789049948.185104:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559488:0@lo:104: 00000100:00100000:0.0:1789049948.185107:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559232 00000100:00100000:0.0:1789049948.185145:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559360 00000100:00100000:0.0:1789049948.185149:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559360 00000100:00100000:2.0:1789049948.185155:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.185173:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559488 00000100:00100000:0.0:1789049948.185178:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559488 00010000:00010000:2.0:1789049948.185184:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.185195:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185202:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049948.185218:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+6:6510:x1875954714559104:12345-0@lo:104: 00000100:00100000:2.0:1789049948.185220:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559616:0@lo:104: 00010000:00010000:0.0:1789049948.185248:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.185258:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049948.185298:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87571b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789049948.185373:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049948.185383:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+6:6510:x1875954714559104:12345-0@lo:104: Request processed in 167us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.185392:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049948.185408:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559616 00000100:00100000:0.0:1789049948.185412:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559616 00000100:00100000:0.0:1789049948.185426:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049948.185447:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+6:6510:x1875954714559232:12345-0@lo:104: 00010000:00010000:0.0:1789049948.185458:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.185501:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789049948.185507:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+6:6510:x1875954714559232:12345-0@lo:104: Request processed in 63us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.185512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789049948.185530:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789049948.185536:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789049948.185544:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185547:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+5:6510:x1875954714559360:12345-0@lo:104: 00010000:00010000:0.0:1789049948.185565:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185567:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049948.185577:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185591:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049948.185600:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.185604:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:1.0:1789049948.185613:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789049948.185621:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+5:6510:x1875954714559360:12345-0@lo:104: Request processed in 72us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.185629:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049948.185647:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049948.185654:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6510:x1875954714559488:12345-0@lo:104: 00010000:00010000:1.0:1789049948.185663:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.185664:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185682:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049948.185715:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.185723:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789049948.185726:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043e00/0x3b8ec5973df570c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185735:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6510:x1875954714559488:12345-0@lo:104: Request processed in 79us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.185759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789049948.185770:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789049948.185775:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049948.185794:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6510:x1875954714559616:12345-0@lo:104: 00010000:00010000:1.0:1789049948.185795:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049948.185801:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.185826:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185827:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049948.185872:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049948.185881:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049948.185901:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185907:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049948.185910:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789049948.185915:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.185918:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6510:x1875954714559616:12345-0@lo:104: Request processed in 125us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.185976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789049948.185978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d6800/0x3b8ec5973df5709d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.185998:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789049948.186008:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186016:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6200 already unused, calling callback (ffffffffc1287c20) 00010000:00010000:0.0:1789049948.186019:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1789049948.186020:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186031:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049948.186038:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049948.186043:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049948.186062:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.186070:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714559744:0@lo:103: 00010000:00010000:1.0:1789049948.186072:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049948.186093:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186101:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df57081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186112:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789049948.186117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049948.186130:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186140:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049948.186144:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186164:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049948.186171:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.186176:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:1.0:1789049948.186178:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789049948.186186:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714559872:0@lo:103: 00010000:00010000:1.0:1789049948.186201:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186210:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789049948.186219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049948.186220:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186230:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d7e00/0x3b8ec5973df56fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df56fd9 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186244:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049948.186248:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049948.186253:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049948.186272:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559744 00000100:00100000:1.0:1789049948.186279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714560000:0@lo:103: 00000100:00100000:0.0:1789049948.186280:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559744 00010000:00010000:0.0:1789049948.186307:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 19 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.186332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.186334:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714559872 00000100:00100000:0.0:1789049948.186340:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714559872 00010000:00010000:0.0:1789049948.186355:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 20 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.186370:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049948.186379:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560000 00000100:00100000:1.0:1789049948.186381:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714560128:0@lo:103: 00000100:00100000:0.0:1789049948.186385:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560000 00010000:00010000:0.0:1789049948.186408:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 21 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.186418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.186441:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560128 00000100:00100000:0.0:1789049948.186446:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560128 00000100:00100000:1.0:1789049948.186470:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789049948.186474:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 22 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.186488:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714559744:12345-0@lo:103: 00000100:00100000:0.0:1789049948.186499:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789049948.186505:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789049948.186511:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714559872:12345-0@lo:103: 00010000:00010000:1.0:1789049948.186524:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 22 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.186528:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049948.186539:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 22 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.186547:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 22 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.186687:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559104:0@lo:104: 00000100:00100000:2.0:1789049948.186698:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559232:0@lo:104: 00000100:00100000:2.0:1789049948.186706:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559360:0@lo:104: 00000100:00100000:2.0:1789049948.186714:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559488:0@lo:104: 00000100:00100000:2.0:1789049948.186722:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1875954714559616:0@lo:104: 00010000:00010000:0.0:1789049948.186810:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 22 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.186831:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df570a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5709d expref: 22 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.186846:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049948.186896:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+21:3646:x1875954714559872:12345-0@lo:103: Request processed in 389us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.186903:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049948.186929:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049948.186974:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+20:3644:x1875954714560000:12345-0@lo:103: 00000100:00100000:3.0:1789049948.186981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714559872:0@lo:103: 00010000:00010000:0.0:1789049948.187004:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049948.187012:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 20 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187023:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 20 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187035:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57081 expref: 20 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187055:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049948.187095:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+19:3644:x1875954714560000:12345-0@lo:103: Request processed in 159us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.187101:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049948.187132:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049948.187144:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+18:3644:x1875954714560128:12345-0@lo:103: 00010000:00010000:0.0:1789049948.187154:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789049948.187155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714560000:0@lo:103: 00010000:00010000:0.0:1789049948.187165:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187191:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187204:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d6e00/0x3b8ec5973df56fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df56fd2 expref: 18 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.187215:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049948.187250:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+17:3644:x1875954714560128:12345-0@lo:103: Request processed in 109us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.187257:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049948.187295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714560128:0@lo:103: 00010000:00010000:3.0:1789049948.188342:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.188346:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.188349:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049948.188501:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030e00/0x3b8ec5973df570ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df570c7 expref: 16 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.188519:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049948.188595:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714559744:12345-0@lo:103: Request processed in 2113us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049948.188604:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789049948.188611:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.188625:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049948.188630:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.188640:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049948.188661:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049948.188668:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789049948.188706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714559744:0@lo:103: 00010000:00010000:0.0:1789049948.188723:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.188732:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049948.188753:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.188761:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df57049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57050 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049948.188767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714560256:0@lo:103: 00010000:00010000:0.0:1789049948.188788:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049948.188793:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049948.188796:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049948.188819:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.189014:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560256 00000100:00100000:0.0:1789049948.189023:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560256 00010000:00010000:0.0:1789049948.189052:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 15 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.189088:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049948.189100:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714560256:12345-0@lo:103: 00010000:00010000:0.0:1789049948.189112:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049948.189118:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 15 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189139:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 15 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189161:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031600/0x3b8ec5973df57050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57049 expref: 15 pid: 6513 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189176:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189184:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189199:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189206:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189212:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189218:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189224:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789049948.189227:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189233:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.189475:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.189491:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.189497:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789049948.189506:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1789049948.189804:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189827:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df5710d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.189848:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049948.190761:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+14:3646:x1875954714560256:12345-0@lo:103: Request processed in 1660us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.190774:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049948.190802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714560256:0@lo:103: 00000100:00100000:2.0:1789049948.193148:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+13:8426:x1875954714558976:12345-0@lo:253: Request processed in 15335us (20963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.193171:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789049948.193216:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714558976:0@lo:253: 10000000:01000000:0.0:1789049948.193240:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789049948.193244:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789049948.193246:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049948.193247:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049948.193249:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789049948.193250:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049948.193252:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049948.193253:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049948.193255:0:8426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789049948.193257:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049948.193259:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789049948.193287:0:8426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8baaac621000 from lustre-OST0000 10000000:01000000:0.0:1789049948.193326:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789049948.193330:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789049948.193339:0:8426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857ab380 local copy 10000000:01000000:0.0:1789049948.193344:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049948.193389:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.193402:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.193412:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.193450:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560384:0@lo:101: 00000100:00100000:0.0:1789049948.193511:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.193560:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.194098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560384 00000100:00100000:2.0:1789049948.194110:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560384 00000100:00100000:2.0:1789049948.194173:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789049948.194182:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+13:8426:x1875954714560384:12345-0@lo:101: 00010000:00010000:2.0:1789049948.194197:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049948.194217:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177600/0x3b8ec5973df5711b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57114 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.194245:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177600/0x3b8ec5973df5711b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57114 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.194501:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177600/0x3b8ec5973df5711b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57114 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.194511:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177600, rc 0) 00000100:00100000:2.0:1789049948.194617:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714560384:12345-0@lo:101: Request processed in 436us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.194625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789049948.196411:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560384:0@lo:101: 00010000:00010000:1.0:1789049948.196445:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.196459:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.196605:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560512:0@lo:501: 00000100:00100000:1.0:1789049948.196665:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.196875:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.196925:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560512 00000100:00100000:2.0:1789049948.196932:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560512 00000100:00100000:2.0:1789049948.197042:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789049948.197053:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714560512:12345-0@lo:501: 00000100:00100000:2.0:1789049948.197266:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714560512:12345-0@lo:501: Request processed in 213us (598us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789049948.197275:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789049948.197495:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560512:0@lo:501: 10000000:01000000:1.0:1789049948.197512:0:8426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789049948.197535:0:8426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789049948.197542:0:8426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.197573:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.197582:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.197654:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049948.197685:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baaac621000 10000000:01000000:1.0:1789049948.197691:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049948.197698:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789049948.197700:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049948.197705:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789049948.197709:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789049948.197735:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.197744:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.197753:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.197768:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560640:0@lo:101: 00000100:00100000:1.0:1789049948.197800:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.197834:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.199453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560640 00000100:00100000:2.0:1789049948.199482:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560640 00000100:00100000:2.0:1789049948.199544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789049948.199554:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714560640:12345-0@lo:101: 00010000:00010000:2.0:1789049948.199567:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049948.199583:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57122 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.199611:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.199622:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.199632:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:2.0:1789049948.199695:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714560640:12345-0@lo:101: Request processed in 143us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.199702:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789049948.199858:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560640:0@lo:101: 00010000:00010000:1.0:1789049948.199874:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049948.199895:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049948.200014:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560768:0@lo:501: 00000100:00100000:1.0:1789049948.200049:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.200075:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.200138:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560768 00000100:00100000:2.0:1789049948.200143:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560768 00000100:00100000:2.0:1789049948.200173:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789049948.200181:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714560768:12345-0@lo:501: 00000100:00100000:2.0:1789049948.200306:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714560768:12345-0@lo:501: Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.200314:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789049948.200434:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560768:0@lo:501: 00000100:00100000:1.0:1789049948.200459:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560896:0@lo:503: 00000100:00100000:1.0:1789049948.200505:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.200526:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.200574:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714560896 00000100:00100000:2.0:1789049948.200579:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714560896 00000100:00100000:2.0:1789049948.200605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789049948.200611:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714560896:12345-0@lo:503: 00000100:00100000:2.0:1789049948.200734:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714560896:12345-0@lo:503: Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.200746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1789049948.203161:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049948.203184:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203197:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789049948.203202:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203213:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049948.203221:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049948.203226:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049948.203273:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203279:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049948.203321:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203342:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031200/0x3b8ec5973df57114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df5711b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049948.203370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789049948.203371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.203375:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049948.203408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714561024:0@lo:103: 00000100:00100000:0.0:1789049948.203498:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.203646:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561024 00000100:00100000:3.0:1789049948.203656:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561024 00000100:00100000:3.0:1789049948.203721:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049948.203732:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714561024:12345-0@lo:103: 00010000:00010000:3.0:1789049948.203753:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049948.203771:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177600/0x3b8ec5973df5711b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57114 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.203789:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049948.203861:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+14:3646:x1875954714561024:12345-0@lo:103: Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.203868:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049948.203980:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714561024:0@lo:103: 00000100:00100000:1.0:1789049948.204361:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714560896:0@lo:503: 00000040:00080000:1.0:1789049948.204741:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049948.204849:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561152:0@lo:502: 00000100:00100000:1.0:1789049948.204912:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.205430:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.205478:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561152 00000100:00100000:2.0:1789049948.205486:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561152 00000100:00100000:3.0:1789049948.205836:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789049948.205848:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714561152:12345-0@lo:502: 00000100:00100000:3.0:1789049948.207106:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714561152:12345-0@lo:502: Request processed in 1253us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.207117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789049948.207234:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561152:0@lo:502: 00000040:00080000:1.0:1789049948.207534:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789049948.207586:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789049948.207603:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789049948.207617:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789049948.207629:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789049948.207641:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789049948.207676:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561280:0@lo:502: 00000100:00100000:1.0:1789049948.207723:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049948.208712:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a95180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049948.209348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561280 00000100:00100000:0.0:1789049948.209362:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561280 00000100:00100000:1.0:1789049948.209478:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789049948.209487:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714561280:12345-0@lo:502: 00000100:00100000:1.0:1789049948.209685:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714561280:12345-0@lo:502: Request processed in 194us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049948.209693:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789049948.209805:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561280:0@lo:502: 00000040:00080000:0.0:1789049948.209914:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789049948.209964:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789049948.211160:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789049948.211172:0:8450:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789049948.211179:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049948.211182:0:8450:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789049948.211189:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789049948.211208:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8baabd0319c0) 00000020:00000080:0.0:1789049948.211233:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789049948.211240:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789049948.211323:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baaac621000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789049948.211332:0:8450:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789049948.211350:0:8450:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3b8ec5973df57137 00010000:00010000:1.0:1789049948.222585:0:8450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789049948.224163:0:8450:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789049948.226861:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789049948.229646:0:8450:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789049948.237851:0:8450:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789049948.238105:0:8450:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789049948.243885:0:8450:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789049948.248820:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789049948.248837:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049948.248847:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049948.248849:0:8450:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789049948.248854:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049948.248859:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049948.248861:0:8450:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049948.248864:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049948.248867:0:8450:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789049948.248904:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049948.248907:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049948.248908:0:8450:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789049948.248912:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789049948.250362:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789049948.250406:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049948.252064:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.252087:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049948.252108:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac621000 from 1 10000000:01000000:0.0:1789049948.252112:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049948.252168:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.252177:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.252190:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.252220:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561408:0@lo:101: 00000100:00100000:0.0:1789049948.252316:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.252376:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.252853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561408 00000100:00100000:3.0:1789049948.252864:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561408 00000100:00100000:3.0:1789049948.252927:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789049948.252963:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+14:8426:x1875954714561408:12345-0@lo:101: 00010000:00010000:3.0:1789049948.252989:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049948.253004:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5713e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.253035:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.253046:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.253055:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602600, rc 0) 00000100:00100000:3.0:1789049948.253109:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561408:12345-0@lo:101: Request processed in 172us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.253116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789049948.253237:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561408:0@lo:101: 00010000:00010000:0.0:1789049948.253321:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.253332:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.253443:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561536:0@lo:501: 00000100:00100000:0.0:1789049948.253475:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.253508:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.254378:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561536 00000100:00100000:2.0:1789049948.254389:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561536 00000100:00100000:2.0:1789049948.254431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789049948.254442:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561536:12345-0@lo:501: 00000100:00100000:2.0:1789049948.254592:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561536:12345-0@lo:501: Request processed in 151us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.254599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789049948.254740:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561536:0@lo:501: 00000100:00100000:0.0:1789049948.254785:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561664:0@lo:503: 00000100:00100000:0.0:1789049948.254840:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.254896:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049948.256418:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561664 00000100:00100000:2.0:1789049948.256430:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561664 00000100:00100000:2.0:1789049948.256516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789049948.256526:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561664:12345-0@lo:503: 00000100:00100000:2.0:1789049948.256690:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561664:12345-0@lo:503: Request processed in 165us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.256698:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789049948.256781:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561664:0@lo:503: 00000040:00080000:0.0:1789049948.257133:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789049948.257231:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561792:0@lo:502: 00000100:00100000:0.0:1789049948.257293:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.257471:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.257582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561792 00000100:00100000:3.0:1789049948.257588:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561792 00000100:00100000:3.0:1789049948.257616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789049948.257624:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561792:12345-0@lo:502: 00000100:00100000:3.0:1789049948.257726:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561792:12345-0@lo:502: Request processed in 102us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.257733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789049948.257819:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561792:0@lo:502: 00000040:00080000:0.0:1789049948.258062:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789049948.258090:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789049948.258112:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561920:0@lo:502: 00000100:00100000:0.0:1789049948.258159:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.258182:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.258239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714561920 00000100:00100000:3.0:1789049948.258244:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714561920 00000100:00100000:3.0:1789049948.258275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789049948.258282:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561920:12345-0@lo:502: 00000100:00100000:3.0:1789049948.258357:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714561920:12345-0@lo:502: Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.258364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789049948.258489:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714561920:0@lo:502: 00000040:00080000:0.0:1789049948.258528:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789049948.258535:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789049948.258911:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049948.258921:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049948.258924:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049948.258932:0:8454:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baaac621000 00000020:00000080:3.0:1789049948.258960:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049948.258975:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049948.258979:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049948.258980:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789049948.258983:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789049948.259135:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789049948.259158:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049948.259185:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.259197:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049948.259245:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789049948.259259:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baaac621000 10000000:01000000:0.0:1789049948.259263:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baaac621000 10000000:01000000:0.0:1789049948.259273:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049948.259281:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac621000 from 1 10000000:01000000:0.0:1789049948.259284:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049948.259314:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.259323:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.259335:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.259349:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562048:0@lo:101: 00000100:00100000:0.0:1789049948.259389:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.259409:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.259513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562048 00000100:00100000:3.0:1789049948.259519:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562048 00000100:00100000:3.0:1789049948.259548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789049948.259556:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:8426:x1875954714562048:12345-0@lo:101: 00010000:00010000:3.0:1789049948.259567:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049948.259582:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5714c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.259607:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.259617:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.259626:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603e00, rc 0) 00000100:00100000:3.0:1789049948.259670:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562048:12345-0@lo:101: Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.259676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789049948.259751:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562048:0@lo:101: 00010000:00010000:0.0:1789049948.259765:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.259774:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049948.259842:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562176:0@lo:501: 00000100:00100000:0.0:1789049948.259869:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.259890:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.259931:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562176 00000100:00100000:3.0:1789049948.259967:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562176 00000100:00100000:3.0:1789049948.259987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789049948.259993:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562176:12345-0@lo:501: 00000100:00100000:3.0:1789049948.260097:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562176:12345-0@lo:501: Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.260104:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789049948.260185:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562176:0@lo:501: 00000100:00100000:0.0:1789049948.260212:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562304:0@lo:503: 00000100:00100000:0.0:1789049948.260263:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.260292:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.260383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562304 00000100:00100000:3.0:1789049948.260387:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562304 00000100:00100000:3.0:1789049948.260405:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789049948.260412:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562304:12345-0@lo:503: 00000100:00100000:3.0:1789049948.260495:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562304:12345-0@lo:503: Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.260502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789049948.260630:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562304:0@lo:503: 00000040:00080000:0.0:1789049948.260890:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789049948.260996:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562432:0@lo:502: 00000100:00100000:0.0:1789049948.261037:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.261057:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.261119:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562432 00000100:00100000:3.0:1789049948.261134:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562432 00000100:00100000:3.0:1789049948.261161:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789049948.261167:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562432:12345-0@lo:502: 00000100:00100000:3.0:1789049948.261267:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562432:12345-0@lo:502: Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.261273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789049948.261462:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562432:0@lo:502: 00000040:00080000:0.0:1789049948.261681:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789049948.261709:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789049948.261723:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789049948.261736:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789049948.261749:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789049948.261763:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789049948.261774:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789049948.261784:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789049948.261794:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789049948.261804:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789049948.261815:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789049948.261828:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789049948.261840:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789049948.261852:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789049948.261866:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789049948.261894:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789049948.261910:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789049948.261924:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789049948.262080:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789049948.262100:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789049948.262114:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789049948.262139:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789049948.262152:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789049948.262164:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789049948.262186:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789049948.262201:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789049948.262214:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789049948.262227:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789049948.262239:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789049948.262319:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789049948.262337:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789049948.262364:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789049948.262380:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789049948.262392:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789049948.262403:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789049948.262417:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789049948.262431:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789049948.262463:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562560:0@lo:502: 00000100:00100000:0.0:1789049948.262518:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.262585:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049948.262682:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562560 00000100:00100000:1.0:1789049948.262689:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562560 00000100:00100000:3.0:1789049948.262750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789049948.262761:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562560:12345-0@lo:502: 00000100:00100000:3.0:1789049948.262908:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714562560:12345-0@lo:502: Request processed in 149us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.262916:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789049948.263210:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714562560:0@lo:502: 00000040:00080000:0.0:1789049948.263331:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789049948.263342:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789049948.263829:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789049948.263847:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8baab4e3b380) 00000020:00000080:3.0:1789049948.263874:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789049948.264217:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baaac621000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049948.264223:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baaac621000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049948.264231:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac621000 3 00010000:00080000:3.0:1789049948.264343:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba981a0c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.142@tcp at head 00010000:00010000:0.0:1789049948.265505:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.268338:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789049948.269392:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789049948.269444:0:8455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789049948.269476:0:8455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3b8ec5973df57161 00000100:00080000:3.0:1789049948.269489:0:8455:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049948.269502:0:8455:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ba981a0c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049948.269547:0:8455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaa7dcbb80 x1875954714562688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049948.269565:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789049948.269674:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714562816:0@lo:400: 00000100:00100000:3.0:1789049948.269763:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.269807:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049948.269813:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714562944:0@lo:400: 00000100:00100000:3.0:1789049948.269841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.269880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714563072:0@lo:400: 00000100:00100000:3.0:1789049948.269905:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.269928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049948.269934:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714563200:0@lo:400: 00000100:00100000:3.0:1789049948.269987:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.270023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562816 00000100:00100000:3.0:1789049948.270031:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562816 00000100:00100000:3.0:1789049948.270074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563072 00000100:00100000:3.0:1789049948.270077:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563072 00000100:00100000:3.0:1789049948.270094:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049948.270103:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714562816:12345-0@lo:400: 00000100:00100000:3.0:1789049948.270168:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714562816:12345-0@lo:400: Request processed in 64us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.270182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049948.270199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049948.270205:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714563072:12345-0@lo:400: 00000100:00100000:3.0:1789049948.270238:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714563072:12345-0@lo:400: Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.270244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049948.270263:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562944 00000100:00100000:3.0:1789049948.270266:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562944 00000100:00100000:3.0:1789049948.270282:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563200 00000100:00100000:3.0:1789049948.270284:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563200 00000100:00100000:3.0:1789049948.270296:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049948.270302:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714562944:12345-0@lo:400: 00000100:00100000:3.0:1789049948.270332:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714562944:12345-0@lo:400: Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.270339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049948.270350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049948.270355:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714563200:12345-0@lo:400: 00000100:00100000:3.0:1789049948.270382:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714563200:12345-0@lo:400: Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.270387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049948.270436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714563200:0@lo:400: 00010000:00080000:3.0:1789049948.270449:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dcb480 x1875954714563072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049948.270458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714563072:0@lo:400: 00000100:00100000:3.0:1789049948.270487:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714562944:0@lo:400: 00010000:00080000:3.0:1789049948.270504:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dcad80 x1875954714562816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049948.270513:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714562816:0@lo:400: 00000020:01000004:3.0:1789049948.270694:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789049948.270711:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8baab4e3cd40) 00000020:00000080:3.0:1789049948.270731:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789049948.270819:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baaac621000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049948.270824:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baaac621000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049948.270827:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac621000 3 00010000:00080000:3.0:1789049948.270857:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba982284000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.142@tcp at head 00000100:00100000:2.0:1789049948.272506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714562688:0@lo:38: 00000100:00100000:2.0:1789049948.272587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049948.272684:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714562688 00000100:00100000:2.0:1789049948.272692:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714562688 00000100:00100000:2.0:1789049948.272728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049948.272736:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714562688:12345-0@lo:38: 00010000:00080000:2.0:1789049948.272766:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1789049948.272803:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3b8ec5973df5716f 00000004:00100000:2.0:1789049948.272829:0:6520:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789049948.272867:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8baaae729000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049948.272920:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875954714562688:12345-0@lo:38: Request processed in 183us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.272927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789049948.273000:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dcbb80 x1875954714562688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049948.273011:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049948.273020:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789049948.273028:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789049948.273033:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049948.273036:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789049948.273042:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714562688:0@lo:38: 00010000:00010000:3.0:1789049948.275730:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789049948.276845:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789049948.276902:0:8455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789049948.276917:0:8455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3b8ec5973df57176 00000100:00080000:3.0:1789049948.276932:0:8455:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049948.276965:0:8455:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ba982284000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049948.277008:0:8455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba98227f800 x1875954714563328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049948.277031:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789049948.279276:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714563328:0@lo:38: 00000100:00100000:2.0:1789049948.279370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049948.283405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563328 00000100:00100000:2.0:1789049948.283424:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563328 00000100:00100000:2.0:1789049948.283483:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049948.283492:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714563328:12345-0@lo:38: 00010000:00080000:2.0:1789049948.283527:0:6519:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1789049948.284239:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3b8ec5973df5717d 00000004:00100000:2.0:1789049948.286177:0:6519:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789049948.286323:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8baaae72d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049948.286445:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875954714563328:12345-0@lo:38: Request processed in 2951us (7073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.286457:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789049948.287413:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227f800 x1875954714563328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049948.287426:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049948.287437:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789049948.287447:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789049948.287453:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789049948.287457:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba982284000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789049948.287463:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714563328:0@lo:38: 00000040:00080000:0.0:1789049948.287976:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1789049948.288046:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789049948.288079:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049948.288094:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.288106:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789049948.288168:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789049948.288170:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049948.288172:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049948.288173:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049948.288174:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049948.288176:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049948.288177:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049948.288179:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049948.288180:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049948.288182:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049948.288183:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049948.288189:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789049948.288192:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049948.288193:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049948.288194:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049948.288195:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049948.288197:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049948.288198:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049948.288199:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049948.288200:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049948.288201:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049948.288202:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049948.288203:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049948.288229:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789049948.288314:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714563456:0@lo:253: 00000100:00100000:0.0:1789049948.288385:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.288422:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049948.288582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563456 00000100:00100000:3.0:1789049948.288590:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563456 00000100:00100000:3.0:1789049948.288638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789049948.288649:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714563456:12345-0@lo:253: 20000000:01000000:3.0:1789049948.288676:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789049948.288695:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789049948.297508:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789049948.297562:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789049948.298816:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:8426:x1875954714563456:12345-0@lo:253: Request processed in 10159us (10421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.298832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789049948.299016:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:8426:1875954714563456:0@lo:253: 10000000:01000000:1.0:1789049948.299034:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789049948.299038:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049948.299049:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789049948.299051:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049948.299053:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049948.299054:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049948.299055:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049948.299057:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049948.299058:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049948.299060:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049948.299061:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049948.299063:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789049948.299079:0:8426:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789049948.299768:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789049948.299776:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789049948.299803:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.299822:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.299830:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.299838:0:6534:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.299882:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.299903:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 15 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.300006:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714563584:0@lo:104: 00000100:00100000:2.0:1789049948.300147:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049948.300204:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.300213:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 15 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.300222:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714563712:0@lo:104: 00000100:00100000:2.0:1789049948.300242:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85155a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049948.300309:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789049948.300367:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049948.300411:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563584 00000100:00100000:0.0:1789049948.300420:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563584 00000100:00100000:0.0:1789049948.300461:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563712 00000100:00100000:0.0:1789049948.300463:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563712 00000100:00100000:0.0:1789049948.300483:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049948.300491:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714563584:12345-0@lo:104: 00010000:00010000:0.0:1789049948.300509:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.300587:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049948.300594:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714563584:12345-0@lo:104: Request processed in 103us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.300601:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049948.300652:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049948.300658:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714563712:12345-0@lo:104: 00010000:00010000:0.0:1789049948.300665:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.300706:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789049948.300711:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714563712:12345-0@lo:104: Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049948.300716:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789049948.300741:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789049948.300746:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.300754:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049948.300759:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.300769:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049948.300782:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.300786:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.300804:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049948.300808:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049948.300811:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049948.300833:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049948.300839:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049948.300850:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049948.300856:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049948.300877:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.300885:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.300887:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049948.300897:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049948.300925:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.300932:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043200/0x3b8ec5973df57073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.300982:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.300983:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049948.300985:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049948.301022:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714563840:0@lo:103: 00000100:00100000:3.0:1789049948.301064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049948.301101:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049948.301106:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714563968:0@lo:103: 00000100:00100000:3.0:1789049948.301140:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049948.301312:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714563584:0@lo:104: 00000100:00100000:2.0:1789049948.301349:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714563712:0@lo:104: 00010000:00010000:2.0:1789049948.301380:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.303639:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.303659:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d7c00/0x3b8ec5973df5708f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57096 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.303686:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049948.303690:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049948.303707:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049948.303731:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563840 00000100:00100000:2.0:1789049948.303747:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563840 00010000:00010000:2.0:1789049948.303795:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 16 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.303840:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714563968 00000100:00100000:2.0:1789049948.303843:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714563968 00010000:00010000:2.0:1789049948.303855:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 17 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049948.303883:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049948.303894:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+17:3644:x1875954714563840:12345-0@lo:103: 00000100:00100000:3.0:1789049948.303923:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789049948.303923:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049948.303929:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 17 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049948.303960:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+17:3644:x1875954714563968:12345-0@lo:103: 00010000:00010000:2.0:1789049948.303967:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 17 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.303971:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049948.303976:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 17 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.303987:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5708f expref: 17 pid: 6512 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.303992:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 17 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.304000:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5707a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57073 expref: 16 pid: 6510 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304006:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304024:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049948.304047:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:2.0:1789049948.304058:0:7461:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008786538s 00010000:00010000:2.0:1789049948.304063:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304070:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304076:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304083:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304089:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789049948.304094:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304102:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304117:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049948.304138:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049948.304202:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+15:3644:x1875954714563968:12345-0@lo:103: Request processed in 270us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.304209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049948.304297:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+14:3644:x1875954714563840:12345-0@lo:103: Request processed in 405us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.304305:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00080000:10000000:1.0:1789049948.305765:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789049948.305924:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789049948.306164:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789049948.306544:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789049948.306743:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789049948.307053:0:8426:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1789049948.307468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714563968:0@lo:103: 00000100:00100000:0.0:1789049948.307482:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714563840:0@lo:103: 00010000:00010000:0.0:1789049948.307541:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.307554:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049948.307562:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57184 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789049948.310187:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789049948.320068:0:8426:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789049948.320080:0:8426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789049948.320133:0:8426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789049948.320192:0:8426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789049948.320211:0:8426:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789049948.320235:0:8426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789049948.321211:0:8426:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789049948.321642:0:8426:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:3.0:1789049949.221501:0:8512:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049949.221709:0:8512:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789049949.294012:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049949.296164:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714564096:0@lo:41: 00000100:00100000:0.0:1789049949.296272:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049949.296415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564096 00000100:00100000:1.0:1789049949.296425:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564096 00000100:00100000:1.0:1789049949.296484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049949.296494:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714564096:12345-0@lo:41: 00000004:00000024:1.0:1789049949.296534:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789049949.301969:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714564096:12345-0@lo:41: Request processed in 5465us (5686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049949.301998:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049949.303484:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714564096:0@lo:41: 00000100:00100000:0.0:1789049949.801288:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049949.801332:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714564224:0@lo:41: 00000100:00100000:0.0:1789049949.801423:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049949.801553:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564224 00000100:00100000:2.0:1789049949.801563:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564224 00000100:00100000:2.0:1789049949.801627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049949.801655:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714564224:12345-0@lo:41: 00000004:00000024:2.0:1789049949.801698:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789049949.801753:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714564224:12345-0@lo:41: Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049949.801761:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049949.801866:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714564224:0@lo:41: 00010000:00010000:3.0:1789049950.315825:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049951.337193:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789049951.337209:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab0ea0000 from 30 10000000:01000000:1.0:1789049951.337214:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049951.337257:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.337268:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.337280:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049951.337312:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564352:0@lo:101: 00000100:00100000:1.0:1789049951.337382:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.337425:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564352 00000100:00100000:2.0:1789049951.337434:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564352 00000100:00100000:1.0:1789049951.337443:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049951.337488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789049951.337498:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+14:6515:x1875954714564352:12345-0@lo:101: 00010000:00010000:2.0:1789049951.337514:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049951.337527:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5718b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.337550:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.337574:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.337584:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177c00, rc 0) 00000100:00100000:2.0:1789049951.337629:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564352:12345-0@lo:101: Request processed in 133us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.337636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789049951.337872:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564352:0@lo:101: 00010000:00010000:1.0:1789049951.337888:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.337907:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049951.337983:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564480:0@lo:501: 00000100:00100000:1.0:1789049951.338006:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.338031:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfbf00 going to sleep for 11 seconds 00010000:00010000:0.0:1789049951.338520:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049951.339184:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564480 00000100:00100000:3.0:1789049951.339307:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564480 00000100:00100000:3.0:1789049951.339542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789049951.339554:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564480:12345-0@lo:501: 00000100:00100000:3.0:1789049951.339721:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564480:12345-0@lo:501: Request processed in 169us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.339741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789049951.339826:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564480:0@lo:501: 00000100:00100000:2.0:1789049951.339874:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564608:0@lo:503: 00000100:00100000:2.0:1789049951.339922:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.346383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564608 00000100:00100000:1.0:1789049951.346399:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564608 00000100:00100000:1.0:1789049951.346474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789049951.346618:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564608:12345-0@lo:503: 00000100:00100000:1.0:1789049951.346777:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564608:12345-0@lo:503: Request processed in 294us (6855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.346786:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789049951.354933:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8577e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.354996:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564608:0@lo:503: 00000100:00100000:1.0:1789049951.357580:0:8620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8620:1875954714564736:0@lo:502: 00000100:00100000:1.0:1789049951.357666:0:8620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.357714:0:8620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.357973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564736 00000100:00100000:3.0:1789049951.357981:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564736 00000100:00100000:3.0:1789049951.358029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789049951.358048:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:8620:x1875954714564736:12345-0@lo:502: 00000100:00100000:3.0:1789049951.358198:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:8620:x1875954714564736:12345-0@lo:502: Request processed in 160us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.358206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789049951.358468:0:8620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8620:1875954714564736:0@lo:502: 00000100:00100000:1.0:1789049951.358520:0:8620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8620:1875954714564864:0@lo:502: 00000100:00100000:1.0:1789049951.358685:0:8620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.358717:0:8620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa851550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049951.358774:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564864 00000100:00100000:2.0:1789049951.358787:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564864 00000100:00100000:2.0:1789049951.358823:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789049951.358832:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8620:x1875954714564864:12345-0@lo:502: 00000100:00100000:2.0:1789049951.358923:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:8620:x1875954714564864:12345-0@lo:502: Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.358930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789049951.359023:0:8620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8620:1875954714564864:0@lo:502: 00000040:00080000:1.0:1789049951.359053:0:8620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789049951.359282:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789049951.359304:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049951.359314:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.359325:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049951.359335:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789049951.359338:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baab0ea0000 from 5 10000000:01000000:0.0:1789049951.359353:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049951.359380:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.359388:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.359397:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.359416:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564992:0@lo:101: 00000100:00100000:0.0:1789049951.359447:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.359475:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.360040:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714564992 00000100:00100000:1.0:1789049951.360047:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714564992 00000100:00100000:1.0:1789049951.360082:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789049951.360090:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714564992:12345-0@lo:101: 00010000:00010000:1.0:1789049951.360110:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049951.360126:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57199 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.360149:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.360174:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.360182:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:1.0:1789049951.360224:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714564992:12345-0@lo:101: Request processed in 135us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.360230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789049951.360318:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714564992:0@lo:101: 00010000:00010000:0.0:1789049951.360334:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.360343:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.360394:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565120:0@lo:256: 00000100:00100000:0.0:1789049951.360431:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.360462:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.360541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565120 00000100:00100000:3.0:1789049951.360546:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565120 00000100:00100000:3.0:1789049951.360585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789049951.360592:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714565120:12345-0@lo:256: 20000000:01000000:3.0:1789049951.360605:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789049951.360622:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789049951.360625:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789049951.360705:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714565120:12345-0@lo:256: Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.360712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789049951.360742:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565120:0@lo:256: 10000000:01000000:3.0:1789049951.360787:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049951.360792:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.360800:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049951.360808:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789049951.360815:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789049951.360818:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789049951.360850:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.360858:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.360866:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.360879:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565248:0@lo:101: 00000100:00100000:3.0:1789049951.360905:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.360924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565248 00000100:00100000:3.0:1789049951.360928:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565248 00000100:00100000:3.0:1789049951.360969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789049951.360976:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714565248:12345-0@lo:101: 00010000:00010000:3.0:1789049951.360983:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049951.360990:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df571a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.361005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.361013:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.361019:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789049951.361042:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714565248:12345-0@lo:101: Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.361056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789049951.361078:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.361088:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565248:0@lo:101: 00010000:00010000:3.0:1789049951.361107:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.361115:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.361160:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565376:0@lo:501: 00000100:00100000:3.0:1789049951.361181:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.361199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565376 00000100:00100000:3.0:1789049951.361202:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565376 00000100:00100000:3.0:1789049951.361218:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789049951.361224:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714565376:12345-0@lo:501: 00000100:00100000:3.0:1789049951.361321:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714565376:12345-0@lo:501: Request processed in 96us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.361327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789049951.361347:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.361357:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565376:0@lo:501: 00000100:00100000:3.0:1789049951.361381:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565504:0@lo:503: 00000100:00100000:3.0:1789049951.361419:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.361437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565504 00000100:00100000:3.0:1789049951.361441:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565504 00000100:00100000:3.0:1789049951.361456:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789049951.361461:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714565504:12345-0@lo:503: 00000100:00100000:3.0:1789049951.361545:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714565504:12345-0@lo:503: Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.361551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789049951.361578:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.361588:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714565504:0@lo:503: 00000100:00100000:3.0:1789049951.361765:0:8621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8621:1875954714565632:0@lo:502: 00000100:00100000:3.0:1789049951.361796:0:8621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.361814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565632 00000100:00100000:3.0:1789049951.361818:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565632 00000100:00100000:3.0:1789049951.361835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789049951.361841:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:8621:x1875954714565632:12345-0@lo:502: 00000100:00100000:3.0:1789049951.361910:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:8621:x1875954714565632:12345-0@lo:502: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.361916:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789049951.361968:0:8621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.361979:0:8621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8621:1875954714565632:0@lo:502: 00000020:01000000:3.0:1789049951.362000:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049951.362008:0:8621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789049951.362015:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049951.362021:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789049951.362027:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789049951.362031:0:8621:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:3.0:1789049951.362054:0:8621:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789049951.362057:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049951.362081:0:8621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8baaae6e0000) 00000020:00000080:3.0:1789049951.362114:0:8621:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789049951.362121:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789049951.362206:0:8621:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789049951.362212:0:8621:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789049951.362221:0:8621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df571bc 00010000:00080000:3.0:1789049951.362261:0:8621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba981a08800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789049951.362514:0:8621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789049951.369410:0:8621:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789049951.369437:0:8621:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789049951.369662:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049951.369885:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049951.370010:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789049951.370127:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789049951.373613:0:8622:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789049951.373620:0:8622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789049951.374795:0:8621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789049951.374808:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789049951.374917:0:8621:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789049951.374975:0:8621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df571c3 00000100:00080000:3.0:1789049951.374987:0:8621:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049951.375000:0:8621:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ba981a08800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049951.375327:0:8621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba98227c700 x1875954714565760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049951.375392:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714565760:0@lo:8: 00000100:00100000:0.0:1789049951.375464:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789049951.375579:0:8621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789049951.375655:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049951.375659:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049951.375661:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789049951.375664:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049951.375668:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049951.375670:0:8621:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049951.375673:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049951.375674:0:8621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789049951.375701:0:8621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8621:1875954714565888:0@lo:502: 00000100:00100000:3.0:1789049951.375747:0:8621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.375781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565888 00000100:00100000:3.0:1789049951.375787:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565888 00000100:00100000:3.0:1789049951.375827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789049951.375847:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:8621:x1875954714565888:12345-0@lo:502: 00000100:00100000:3.0:1789049951.375986:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:8621:x1875954714565888:12345-0@lo:502: Request processed in 150us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.376000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789049951.376178:0:8621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.376201:0:8621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8621:1875954714565888:0@lo:502: 00000020:01000000:3.0:1789049951.376228:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049951.376232:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049951.376234:0:8621:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049951.376237:0:8621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789049951.376290:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789049951.376309:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789049951.376319:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.376331:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049951.376342:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789049951.376345:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac606800 from 30 10000000:01000000:3.0:1789049951.376348:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049951.376374:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.376382:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.376392:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.376404:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714566016:0@lo:101: 00000100:00100000:3.0:1789049951.376433:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.376457:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.376609:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566016 00000100:00100000:0.0:1789049951.376614:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566016 00000100:00100000:0.0:1789049951.376644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049951.376651:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714566016:12345-0@lo:101: 00010000:00010000:0.0:1789049951.376661:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049951.376674:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df571ca expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.376702:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.376713:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.376721:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030800, rc 0) 00000100:00100000:0.0:1789049951.376751:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714566016:12345-0@lo:101: Request processed in 100us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.376757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789049951.377278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714566272:0@lo:400: 00000100:00100000:2.0:1789049951.377311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.377331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714566784:0@lo:400: 00000100:00100000:2.0:1789049951.377351:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.377367:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789049951.377371:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714566144:0@lo:400: 00000100:00100000:2.0:1789049951.377386:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.377398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714566656:0@lo:400: 00000100:00100000:2.0:1789049951.377412:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.377439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566272 00000100:00100000:2.0:1789049951.377443:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566272 00000100:00100000:2.0:1789049951.377473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049951.377480:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714566272:12345-0@lo:400: 00000100:00100000:2.0:1789049951.377522:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714566272:12345-0@lo:400: Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.377528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049951.377549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566784 00000100:00100000:2.0:1789049951.377552:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566784 00000100:00100000:2.0:1789049951.377581:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566144 00000100:00100000:2.0:1789049951.377592:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566144 00000100:00100000:2.0:1789049951.377606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566656 00000100:00100000:2.0:1789049951.377608:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566656 00000100:00100000:2.0:1789049951.377621:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049951.377627:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714566784:12345-0@lo:400: 00000100:00100000:2.0:1789049951.377659:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714566784:12345-0@lo:400: Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.377665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049951.377676:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049951.377681:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714566144:12345-0@lo:400: 00000100:00100000:2.0:1789049951.377704:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714566144:12345-0@lo:400: Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.377710:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049951.377720:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049951.377725:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714566656:12345-0@lo:400: 00000100:00100000:2.0:1789049951.377749:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714566656:12345-0@lo:400: Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.377755:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789049951.377790:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03100 x1875954714566144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049951.377801:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714566144:0@lo:400: 00010000:00080000:2.0:1789049951.377811:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03800 x1875954714566656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049951.377817:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714566656:0@lo:400: 00000100:00100000:2.0:1789049951.377825:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714566272:0@lo:400: 00010000:00080000:2.0:1789049951.377859:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b02d80 x1875954714566784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049951.377867:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714566784:0@lo:400: 00000100:00100000:3.0:1789049951.377976:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714566528:0@lo:400: 00000100:00100000:3.0:1789049951.378008:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.378044:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049951.378051:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714566400:0@lo:400: 00000100:00100000:3.0:1789049951.378072:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.378128:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714566016:0@lo:101: 00010000:00010000:3.0:1789049951.378147:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.378157:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.378218:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714566912:0@lo:501: 00000100:00100000:3.0:1789049951.378244:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.378267:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.378280:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566912 00000100:00100000:3.0:1789049951.378284:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566912 00000100:00100000:3.0:1789049951.378308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789049951.378315:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714566912:12345-0@lo:501: 00000100:00100000:3.0:1789049951.378429:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714566912:12345-0@lo:501: Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.378436:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789049951.378467:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714566912:0@lo:501: 00000100:00100000:3.0:1789049951.378491:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567040:0@lo:503: 00000100:00100000:3.0:1789049951.378529:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.378548:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.378559:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567040 00000100:00100000:3.0:1789049951.378562:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567040 00000100:00100000:3.0:1789049951.378581:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789049951.378587:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714567040:12345-0@lo:503: 00000100:00100000:3.0:1789049951.378662:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714567040:12345-0@lo:503: Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.378670:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789049951.378706:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567040:0@lo:503: 00000100:00100000:3.0:1789049951.378807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566400 00000100:00100000:3.0:1789049951.378811:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566400 00000100:00100000:3.0:1789049951.378835:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049951.378841:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714566400:12345-0@lo:400: 00000100:00100000:3.0:1789049951.378875:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714566400:12345-0@lo:400: Request processed in 35us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.378880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789049951.378906:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03b80 x1875954714566400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.378916:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714566400:0@lo:400: 00000100:00100000:3.0:1789049951.379028:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8624:1875954714567168:0@lo:502: 00000100:00100000:3.0:1789049951.379062:0:8624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.379080:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567168 00000100:00100000:3.0:1789049951.379083:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567168 00000100:00100000:2.0:1789049951.379858:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714566528 00000100:00100000:2.0:1789049951.379867:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714566528 00000100:00100000:2.0:1789049951.379898:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049951.379906:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714566528:12345-0@lo:400: 00000100:00100000:2.0:1789049951.379988:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714566528:12345-0@lo:400: Request processed in 82us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.379995:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049951.380030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714566528:0@lo:400: 00000100:00100000:3.0:1789049951.380573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789049951.380583:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8624:x1875954714567168:12345-0@lo:502: 00000100:00100000:3.0:1789049951.380703:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8624:x1875954714567168:12345-0@lo:502: Request processed in 121us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.380716:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789049951.380772:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.380786:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8624:1875954714567168:0@lo:502: 00000100:00100000:3.0:1789049951.380990:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8624:1875954714567296:0@lo:502: 00000100:00100000:3.0:1789049951.381108:0:8624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.381133:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049951.381219:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567296 00000100:00100000:2.0:1789049951.381225:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567296 00000100:00100000:2.0:1789049951.381254:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789049951.381261:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8624:x1875954714567296:12345-0@lo:502: 00000100:00100000:2.0:1789049951.381332:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:8624:x1875954714567296:12345-0@lo:502: Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.381339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789049951.382531:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8624:1875954714567296:0@lo:502: 00000040:00080000:3.0:1789049951.382586:0:8624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:1.0:1789049951.382869:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714565760 00000100:00100000:1.0:1789049951.382877:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714565760 00000100:00100000:1.0:1789049951.382918:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049951.382925:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714565760:12345-0@lo:8: 00010000:00080000:1.0:1789049951.382974:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1789049951.383006:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df571d8 00002000:00100000:1.0:1789049951.383063:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8baa85747000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789049951.383068:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789049951.383072:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789049951.383141:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789049951.383368:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789049951.383399:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8baa85740800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049951.383481:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714565760:12345-0@lo:8: Request processed in 555us (8015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.383489:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049951.383547:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227c700 x1875954714565760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.383695:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789049951.383704:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789049951.383719:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789049951.383725:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789049951.383728:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba981a08800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789049951.383742:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789049951.383748:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714565760:0@lo:8: 00000020:01000000:2.0:1789049951.384036:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789049951.384064:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049951.384076:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.384088:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049951.384108:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789049951.384118:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baaac606800 from 5 10000000:01000000:2.0:1789049951.384121:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789049951.384153:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.384161:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049951.384171:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049951.384191:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567424:0@lo:101: 00000100:00100000:2.0:1789049951.384235:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049951.384271:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8577e780 going to sleep for 11 seconds 00000004:00080000:2.0:1789049951.384289:0:8622:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789049951.384354:0:8622:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 173582416126ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789049951.384361:0:8622:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789049951.385783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567424 00000100:00100000:1.0:1789049951.385796:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567424 00000100:00080000:0.0:1789049951.385890:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049951.385897:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789049951.385927:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789049951.385988:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714567424:12345-0@lo:101: 00000100:00100000:0.0:1789049951.385991:0:8623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714567552:0@lo:700: 00010000:00010000:1.0:1789049951.386008:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049951.386027:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df571df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.386058:0:8623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049951.386060:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df571df expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.386074:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571df expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.386084:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043600, rc 0) 00000100:00100000:0.0:1789049951.386116:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567552 00000100:00100000:0.0:1789049951.386121:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567552 00000100:00100000:1.0:1789049951.386148:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714567424:12345-0@lo:101: Request processed in 210us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.386157:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789049951.386164:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049951.386174:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8623:x1875954714567552:12345-0@lo:700: 00000100:00100000:0.0:1789049951.386208:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1875954714567680:0@lo:700: 00000100:00100000:1.0:1789049951.386221:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567424:0@lo:101: 00010000:00010000:1.0:1789049951.386242:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.386247:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049951.386259:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.386272:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a70c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789049951.386285:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049951.386306:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567680 00000100:00100000:0.0:1789049951.386310:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567680 00000100:00100000:1.0:1789049951.386324:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567808:0@lo:256: 00000100:00100000:0.0:1789049951.386345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049951.386354:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1875954714567680:12345-0@lo:700: 00000100:00100000:1.0:1789049951.386438:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.386450:0:8623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.386472:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85155b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.386490:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567808 00000100:00100000:1.0:1789049951.386494:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567808 00000100:00100000:1.0:1789049951.386525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789049951.386532:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714567808:12345-0@lo:256: 20000000:01000000:1.0:1789049951.386546:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049951.386561:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049951.386563:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789049951.386716:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714567808:12345-0@lo:256: Request processed in 183us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.386723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789049951.386797:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567808:0@lo:256: 10000000:01000000:3.0:1789049951.386849:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049951.386857:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.386867:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049951.387208:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789049951.387210:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789049951.387213:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049951.387241:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.387250:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.387259:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.387282:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567936:0@lo:101: 00000100:00100000:3.0:1789049951.387313:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.387337:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f7000 going to sleep for 11 seconds 00000004:00080000:3.0:1789049951.387680:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789049951.387918:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714567936 00000100:00100000:1.0:1789049951.387925:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714567936 00000100:00100000:1.0:1789049951.388129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789049951.388141:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714567936:12345-0@lo:101: 00010000:00010000:1.0:1789049951.388154:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049951.388177:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df571ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.388200:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.388211:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049951.388231:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043200, rc 0) 00000100:00100000:3.0:1789049951.388314:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714567936:0@lo:101: 00010000:00010000:3.0:1789049951.388330:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049951.388339:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049951.388402:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568064:0@lo:501: 00000100:00100000:3.0:1789049951.388430:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.388460:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.388479:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714567936:12345-0@lo:101: Request processed in 151us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.388489:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789049951.388514:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568064 00000100:00100000:0.0:1789049951.388519:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568064 00000100:00100000:0.0:1789049951.388565:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789049951.388575:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714568064:12345-0@lo:501: 00000100:00100000:0.0:1789049951.388681:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714568064:12345-0@lo:501: Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.388687:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789049951.388996:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568064:0@lo:501: 00000100:00100000:3.0:1789049951.389026:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568192:0@lo:503: 00000100:00100000:3.0:1789049951.389137:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.389166:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049951.389221:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568192 00000100:00100000:1.0:1789049951.389225:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568192 00000100:00100000:1.0:1789049951.389262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789049951.389268:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714568192:12345-0@lo:503: 00000100:00100000:1.0:1789049951.389410:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714568192:12345-0@lo:503: Request processed in 141us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.389417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789049951.392822:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568192:0@lo:503: 40000000:02000000:1.0:1789049951.394333:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789049951.397185:0:8626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8626:1875954714568320:0@lo:502: 00000100:00100000:0.0:1789049951.397285:0:8626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.397329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568320 00000100:00100000:0.0:1789049951.397337:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568320 00000100:00100000:0.0:1789049951.397381:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789049951.397390:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:8626:x1875954714568320:12345-0@lo:502: 00000100:00100000:0.0:1789049951.397515:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:8626:x1875954714568320:12345-0@lo:502: Request processed in 125us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.397523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789049951.397575:0:8626:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.397598:0:8626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8626:1875954714568320:0@lo:502: 00000020:01000000:0.0:1789049951.397627:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789049951.397635:0:8626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789049951.397643:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049951.397644:0:8626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789049951.397648:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789049951.397652:0:8626:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:0.0:1789049951.397675:0:8626:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789049951.397677:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789049951.397691:0:8626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8baabd033380) 00000020:00000080:0.0:1789049951.397715:0:8626:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789049951.397728:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789049951.397826:0:8626:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789049951.397832:0:8626:0:(osd_handler.c:8921:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789049951.397839:0:8626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df57202 00010000:00080000:0.0:1789049951.397871:0:8626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab7756000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:0.0:1789049951.398153:0:8626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1789049951.411340:0:8626:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789049951.411368:0:8626:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789049951.411590:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049951.411795:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049951.411889:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789049951.412040:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789049951.412486:0:8627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049951.412492:0:8627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789049951.413320:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1875954714567680:12345-0@lo:700: Request processed in 26963us (27071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.413334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789049951.413361:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dd7800 x1875954714567680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.413379:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1875954714567680:0@lo:700: 40000000:02000000:1.0:1789049951.413394:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:0.0:1789049951.415726:0:8626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789049951.415742:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789049951.415789:0:8626:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789049951.415817:0:8626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df57209 00000100:00080000:0.0:1789049951.415829:0:8626:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049951.415841:0:8626:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8baab7756000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789049951.415882:0:8626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaa7dd5500 x1875954714568448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789049951.415991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714568448:0@lo:8: 00000100:00100000:3.0:1789049951.416058:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789049951.416156:0:8626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789049951.416235:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049951.416241:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049951.416243:0:8626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789049951.416246:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049951.416249:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049951.416251:0:8626:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049951.416260:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049951.416262:0:8626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789049951.416298:0:8626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8626:1875954714568576:0@lo:502: 00000100:00100000:0.0:1789049951.416343:0:8626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.416361:0:8626:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049951.416449:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568448 00000100:00100000:2.0:1789049951.416457:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568448 00000100:00100000:2.0:1789049951.416501:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049951.416509:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875954714568448:12345-0@lo:8: 00010000:00080000:2.0:1789049951.416534:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1789049951.416566:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df57210 00002000:00100000:2.0:1789049951.416580:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8baaae72a800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789049951.416585:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789049951.416588:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789049951.416658:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789049951.416684:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8baaae72e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049951.417745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568576 00000100:00100000:0.0:1789049951.417755:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568576 00000100:00100000:0.0:1789049951.417799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789049951.417806:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:8626:x1875954714568576:12345-0@lo:502: 00000100:00100000:0.0:1789049951.417957:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:8626:x1875954714568576:12345-0@lo:502: Request processed in 150us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.417965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789049951.418028:0:8626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:8626:1875954714568576:0@lo:502: 00000020:01000000:0.0:1789049951.418060:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049951.418066:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049951.418068:0:8626:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789049951.418072:0:8626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789049951.418148:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789049951.418180:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789049951.418191:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418204:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049951.418214:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789049951.418217:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857ab380 from 1 10000000:01000000:0.0:1789049951.418220:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049951.418247:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418261:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418271:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.418288:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568704:0@lo:101: 00000100:00100000:0.0:1789049951.418321:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.418340:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.418354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568704 00000100:00100000:0.0:1789049951.418358:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568704 00000100:00100000:0.0:1789049951.418382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789049951.418388:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714568704:12345-0@lo:101: 00010000:00010000:0.0:1789049951.418396:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049951.418408:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57217 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418431:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418442:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418451:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031200, rc 0) 00000100:00100000:0.0:1789049951.418479:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714568704:12345-0@lo:101: Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.418484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789049951.418515:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568704:0@lo:101: 00010000:00010000:0.0:1789049951.418534:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418543:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049951.418590:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568832:0@lo:501: 00000100:00100000:0.0:1789049951.418614:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049951.418627:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.418640:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568832 00000100:00100000:0.0:1789049951.418643:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568832 00000100:00100000:0.0:1789049951.418664:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789049951.418670:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714568832:12345-0@lo:501: 00000100:00100000:0.0:1789049951.418736:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714568832:12345-0@lo:501: Request processed in 65us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049951.418743:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789049951.418770:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714568832:0@lo:501: 10000000:01000000:0.0:1789049951.418787:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789049951.418792:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049951.418801:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789049951.421758:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789049951.421770:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789049951.421872:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714567552:12345-0@lo:700: Request processed in 35696us (35811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.421892:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049951.422405:0:8623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dd6300 x1875954714567552/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.422420:0:8623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714567552:0@lo:700: 00000100:00100000:2.0:1789049951.422560:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875954714568448:12345-0@lo:8: Request processed in 6049us (6499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049951.422576:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789049951.427212:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dd5500 x1875954714568448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.427234:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789049951.427247:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789049951.427257:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789049951.427264:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789049951.427268:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab7756000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789049951.427291:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789049951.427299:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714568448:0@lo:8: 00000004:00080000:1.0:1789049951.427412:0:8627:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789049951.428239:0:8623:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789049951.428264:0:8623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569088:0@lo:7: 00000100:00100000:1.0:1789049951.428324:0:8623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.428359:0:8623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.428450:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714568960:0@lo:13: 00000100:00100000:0.0:1789049951.428483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.428568:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714568960 00000100:00100000:1.0:1789049951.428576:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714568960 00000100:00100000:1.0:1789049951.428628:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049951.428639:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714568960:12345-0@lo:13: 00002000:00000024:1.0:1789049951.428668:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789049951.428716:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714568960:12345-0@lo:13: Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.428723:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049951.428759:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570b480 x1875954714568960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.428775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714568960:0@lo:13: 00000100:00100000:3.0:1789049951.431306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569088 00000100:00100000:3.0:1789049951.431321:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569088 00000100:00100000:3.0:1789049951.431374:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049951.431386:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714569088:12345-0@lo:7: 00000004:00080000:1.0:1789049951.431392:0:8627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173629452583ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789049951.431400:0:8627:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:3.0:1789049951.438789:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789049951.438798:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789049951.438895:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714569088:12345-0@lo:7: Request processed in 7508us (10567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.438906:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789049951.439000:0:8623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa85709c00 x1875954714569088/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.439016:0:8623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569088:0@lo:7: 00000004:00080000:3.0:1789049951.439034:0:8623:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789049951.439075:0:8623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569216:0@lo:5: 00000100:00100000:3.0:1789049951.439122:0:8623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.439155:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569216 00000100:00100000:3.0:1789049951.439222:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569216 00000100:00100000:3.0:1789049951.439269:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049951.439277:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714569216:12345-0@lo:5: 00002000:00080000:3.0:1789049951.439311:0:8434:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789049951.439340:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714569216:12345-0@lo:5: Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.439346:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049951.439373:0:8623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f73c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789049951.439386:0:8623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227e300 x1875954714569216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.439396:0:8623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569216:0@lo:5: 00000004:00080000:3.0:1789049951.439404:0:8623:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789049951.439425:0:8623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569344:0@lo:5: 00000100:00100000:3.0:1789049951.439444:0:8623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.439461:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569344 00000100:00100000:3.0:1789049951.439464:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569344 00000100:00100000:3.0:1789049951.439482:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049951.439487:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8623:x1875954714569344:12345-0@lo:5: 00002000:00080000:3.0:1789049951.439511:0:8432:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789049951.439629:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049951.439643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714569472:0@lo:13: 00000100:00100000:1.0:1789049951.439686:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.439722:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569472 00000100:00100000:1.0:1789049951.439727:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569472 00000100:00100000:1.0:1789049951.439766:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049951.439775:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714569472:12345-0@lo:13: 00002000:00000024:1.0:1789049951.439789:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789049951.439831:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714569472:12345-0@lo:13: Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.439844:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789049951.439872:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570b480 x1875954714569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.439889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714569472:0@lo:13: 00000004:00080000:1.0:1789049951.439907:0:8628:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789049951.439925:0:8628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569600:0@lo:7: 00000100:00100000:1.0:1789049951.439977:0:8628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.439991:0:8628:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505600 going to sleep for 11 seconds 00000100:00080000:0.0:1789049951.440310:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049951.440353:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789049951.440360:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789049951.441062:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569600 00000100:00100000:1.0:1789049951.441069:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569600 00000100:00100000:0.0:1789049951.441317:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049951.441329:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8628:x1875954714569600:12345-0@lo:7: 00000004:00080000:1.0:1789049951.443002:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789049951.443020:0:8623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.445700:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8623:x1875954714569344:12345-0@lo:5: Request processed in 6206us (6249us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789049951.445714:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789049951.445815:0:8623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227e300 x1875954714569344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.445833:0:8623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8623:1875954714569344:0@lo:5: 00000004:00080000:1.0:1789049951.445850:0:8623:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789049951.445897:0:8623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8623:1875954714569728:0@lo:900: 00000100:00100000:1.0:1789049951.445969:0:8623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.445993:0:8623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.446126:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569728 00000100:00100000:3.0:1789049951.446134:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569728 00000100:00100000:3.0:1789049951.446332:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049951.446343:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8623:x1875954714569728:12345-0@lo:900: 00000100:00100000:3.0:1789049951.446398:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8623:x1875954714569728:12345-0@lo:900: Request processed in 57us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.446404:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789049951.446450:0:8623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570a680 x1875954714569728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.446461:0:8623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8623:1875954714569728:0@lo:900: 00002000:00080000:0.0:1789049951.448898:0:8629:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789049951.448908:0:8629:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789049951.449251:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8628:x1875954714569600:12345-0@lo:7: Request processed in 7920us (9268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.449262:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789049951.449373:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570b480 x1875954714569600/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.449389:0:8628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569600:0@lo:7: 00000004:00080000:1.0:1789049951.449407:0:8628:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789049951.449447:0:8628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569856:0@lo:5: 00000100:00100000:1.0:1789049951.449485:0:8628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.449533:0:8628:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.449659:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569856 00000100:00100000:0.0:1789049951.449666:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569856 00000100:00100000:0.0:1789049951.449711:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049951.449721:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8628:x1875954714569856:12345-0@lo:5: 00002000:00080000:0.0:1789049951.449749:0:8433:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789049951.449753:0:8433:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789049951.450283:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8628:x1875954714569856:12345-0@lo:5: Request processed in 563us (798us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789049951.450291:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789049951.452869:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570b480 x1875954714569856/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.452892:0:8628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569856:0@lo:5: 00000004:00080000:1.0:1789049951.452910:0:8628:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789049951.454165:0:8628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569984:0@lo:700: 00000100:00100000:1.0:1789049951.454236:0:8628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.454288:0:8628:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505600 going to sleep for 11 seconds 00000100:00100000:3.0:1789049951.454536:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714569984 00000100:00100000:3.0:1789049951.454545:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714569984 00000100:00100000:3.0:1789049951.454705:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049951.454715:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8628:x1875954714569984:12345-0@lo:700: 00000001:00080000:0.0:1789049951.463170:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1789049951.463188:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789049951.464438:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8628:x1875954714569984:12345-0@lo:700: Request processed in 9715us (10192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.464454:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789049951.464574:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa8570bb80 x1875954714569984/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049951.464587:0:8628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789049951.464608:0:8628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714569984:0@lo:700: 00000004:02000040:1.0:1789049951.468229:0:8628:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789049951.478060:0:8628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714570112:0@lo:5: 00000100:00100000:1.0:1789049951.478143:0:8628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.478213:0:8628:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae505840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049951.478346:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570112 00000100:00100000:0.0:1789049951.478355:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570112 00000100:00100000:0.0:1789049951.478414:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049951.478424:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8628:x1875954714570112:12345-0@lo:5: 00002000:00080000:0.0:1789049951.482069:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789049951.482093:0:8432:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789049951.491752:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8628:x1875954714570112:12345-0@lo:5: Request processed in 13323us (13602us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789049951.491765:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789049951.492173:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa85708700 x1875954714570112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049951.492191:0:8628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1875954714570112:0@lo:5: 00000004:00080000:1.0:1789049951.492208:0:8628:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789049952.364595:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049953.385729:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049954.409145:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049954.410094:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714570240:0@lo:41: 00000100:00100000:0.0:1789049954.410166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049954.410376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570240 00000100:00100000:2.0:1789049954.410385:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570240 00000100:00100000:2.0:1789049954.410435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049954.410445:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714570240:12345-0@lo:41: 00000004:00000024:2.0:1789049954.410483:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789049954.410533:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714570240:12345-0@lo:41: Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049954.410541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049954.410623:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714570240:0@lo:41: 00000001:02000400:1.0:1789049954.601751:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789049954.921398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714570368:0@lo:41: 00000100:00100000:0.0:1789049954.921472:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049954.921642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570368 00000100:00100000:3.0:1789049954.921652:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570368 00000100:00100000:3.0:1789049954.921713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049954.921731:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714570368:12345-0@lo:41: 00000004:00000024:3.0:1789049954.921769:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789049954.922367:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714570368:12345-0@lo:41: Request processed in 636us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049954.922377:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049954.922453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714570368:0@lo:41: 00010000:00010000:2.0:1789049955.434338:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789049955.451256:0:8863:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789049955.451783:0:8863:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1789049956.226561:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1789049956.457211:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714570624:0@lo:13: 00000100:00100000:2.0:1789049956.457309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049956.457405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714570496:0@lo:13: 00000100:00100000:0.0:1789049956.457436:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049956.457481:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570624 00000100:00100000:0.0:1789049956.457489:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570624 00000100:00100000:0.0:1789049956.457534:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570496 00000100:00100000:0.0:1789049956.457537:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570496 00000100:00100000:0.0:1789049956.457555:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049956.457563:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714570624:12345-0@lo:13: 00002000:00000024:0.0:1789049956.457595:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789049956.461711:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049956.461753:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714570880:0@lo:400: 00000100:00100000:1.0:1789049956.461832:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049956.461876:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049956.461883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714570752:0@lo:400: 00000100:00100000:1.0:1789049956.461909:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049956.461988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714571008:0@lo:400: 00000100:00100000:1.0:1789049956.462018:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049956.462057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570752 00000100:00100000:3.0:1789049956.462367:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049956.462377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714571136:0@lo:400: 00000100:00100000:3.0:1789049956.462411:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049956.462440:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049956.462450:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714570880 00000100:00100000:3.0:1789049956.462456:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570880 00000100:00100000:3.0:1789049956.462501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571136 00000100:00100000:3.0:1789049956.462504:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571136 00000100:00100000:3.0:1789049956.462521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049956.462539:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714570880:12345-0@lo:400: 00000100:00100000:3.0:1789049956.462594:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714570880:12345-0@lo:400: Request processed in 57us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049956.462601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049956.462617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049956.462623:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714571136:12345-0@lo:400: 00000100:00100000:3.0:1789049956.462651:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714571136:12345-0@lo:400: Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049956.462657:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789049956.462693:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227f480 x1875954714570880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049956.462712:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714570880:0@lo:400: 00010000:00080000:3.0:1789049956.462738:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227ea00 x1875954714571136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049956.462746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714571136:0@lo:400: 00000100:00100000:3.0:1789049956.462793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714571392:0@lo:400: 00000100:00100000:1.0:1789049956.462872:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714570752 00000100:00100000:1.0:1789049956.462909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789049956.462917:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:3645:x1875954714570752:12345-0@lo:400: 00000100:00100000:1.0:1789049956.467591:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:3645:x1875954714570752:12345-0@lo:400: Request processed in 4663us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049956.467608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789049956.467683:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714571264:0@lo:400: 00010000:00080000:2.0:1789049956.467824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaae709500 x1875954714570624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049956.467837:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789049956.467868:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714570624:0@lo:13: 00000100:00100000:2.0:1789049956.467888:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049956.467896:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714571520:0@lo:400: 00000100:00100000:2.0:1789049956.467933:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049956.468008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571520 00000100:00100000:2.0:1789049956.468016:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571520 00000100:00100000:2.0:1789049956.468090:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049956.468100:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714571520:12345-0@lo:400: 00000100:00100000:2.0:1789049956.468153:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714571520:12345-0@lo:400: Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049956.468168:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049956.468191:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571008 00000100:00100000:2.0:1789049956.468195:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571008 00000100:00100000:1.0:1789049956.468857:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789049956.468906:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789049956.468988:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571264 00000100:00100000:1.0:1789049956.468993:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571264 00000100:00100000:1.0:1789049956.469015:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049956.469022:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714571264:12345-0@lo:400: 00000100:00100000:1.0:1789049956.469083:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714571264:12345-0@lo:400: Request processed in 61us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049956.469089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049956.469121:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714571264:0@lo:400: 00000100:00100000:0.0:1789049956.469931:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714570624:12345-0@lo:13: Request processed in 12364us (12617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049956.469956:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049956.470169:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049956.470192:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714570496:12345-0@lo:13: 00002000:00000024:0.0:1789049956.470216:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049956.470334:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714570496:12345-0@lo:13: Request processed in 145us (12896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049956.470340:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049956.470573:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049956.470586:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714571008:12345-0@lo:400: 00000100:00100000:2.0:1789049956.470628:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714571008:12345-0@lo:400: Request processed in 46us (8609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049956.470635:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789049956.470680:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227f800 x1875954714571520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049956.470695:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714571520:0@lo:400: 00000100:00100000:1.0:1789049956.471094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714571008:0@lo:400: 00010000:00080000:1.0:1789049956.471108:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baa85708380 x1875954714570496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049956.471117:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789049956.471134:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714570496:0@lo:13: 00000100:00100000:3.0:1789049956.471753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049956.471813:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714570752:0@lo:400: 00000100:00100000:2.0:1789049956.471923:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571392 00000100:00100000:2.0:1789049956.471931:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571392 00000100:00100000:2.0:1789049956.472008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049956.472018:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714571392:12345-0@lo:400: 00000100:00100000:2.0:1789049956.472098:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714571392:12345-0@lo:400: Request processed in 81us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049956.472105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789049956.472334:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227f480 x1875954714571392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049956.472346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714571392:0@lo:400: 00000100:00080000:1.0:1789049956.472498:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789049957.482484:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789049958.079357:0:8964:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789049958.079667:0:8964:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789049958.505589:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789049958.998901:0:9012:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789049958.998911:0:9012:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789049959.529862:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714571648:0@lo:41: 00010000:00010000:3.0:1789049959.530293:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049959.530750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049959.530853:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571648 00000100:00100000:2.0:1789049959.530862:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571648 00000100:00100000:2.0:1789049959.530910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049959.530920:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714571648:12345-0@lo:41: 00000004:00000024:2.0:1789049959.532714:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789049959.532808:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714571648:12345-0@lo:41: Request processed in 1887us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049959.532816:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789049959.533315:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714571648:0@lo:41: 00000100:00100000:2.0:1789049960.041516:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049960.041549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714571776:0@lo:41: 00000100:00100000:2.0:1789049960.041633:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049960.041707:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571776 00000100:00100000:2.0:1789049960.041717:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571776 00000100:00100000:2.0:1789049960.041770:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049960.041780:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714571776:12345-0@lo:41: 00000004:00000024:2.0:1789049960.041820:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789049960.041869:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714571776:12345-0@lo:41: Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049960.041877:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049960.041929:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714571776:0@lo:41: 00010000:00010000:0.0:1789049960.555280:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049961.580221:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714571904:0@lo:13: 00000100:00100000:0.0:1789049961.580311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049961.580500:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714571904 00000100:00100000:3.0:1789049961.580510:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714571904 00000100:00100000:3.0:1789049961.580586:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049961.580598:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714571904:12345-0@lo:13: 00002000:00000024:3.0:1789049961.580649:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789049961.580721:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049961.580842:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714571904:12345-0@lo:13: Request processed in 246us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049961.580851:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049961.580912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714572032:0@lo:400: 00000100:00100000:2.0:1789049961.581002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714572160:0@lo:400: 00000100:00100000:3.0:1789049961.581047:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049961.581057:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049961.581084:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714572544:0@lo:400: 00000100:00100000:2.0:1789049961.581087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714572672:0@lo:400: 00000100:00100000:3.0:1789049961.581124:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049961.581127:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049961.581173:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572160 00000100:00100000:2.0:1789049961.581177:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572160 00000100:00100000:2.0:1789049961.581211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572672 00000100:00100000:2.0:1789049961.581214:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572672 00000100:00100000:2.0:1789049961.581234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049961.581241:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714572160:12345-0@lo:400: 00000100:00100000:2.0:1789049961.581277:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714572160:12345-0@lo:400: Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049961.581290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049961.581303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049961.581308:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714572672:12345-0@lo:400: 00000100:00100000:2.0:1789049961.581335:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714572672:12345-0@lo:400: Request processed in 27us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049961.581341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049961.581359:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572544 00000100:00100000:2.0:1789049961.581362:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572544 00000100:00100000:2.0:1789049961.581383:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049961.581389:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714572544:12345-0@lo:400: 00000100:00100000:2.0:1789049961.581422:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714572544:12345-0@lo:400: Request processed in 33us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049961.581427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789049961.581466:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b00380 x1875954714572160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049961.581479:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714572160:0@lo:400: 00010000:00080000:2.0:1789049961.581489:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01f80 x1875954714572672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049961.581497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714572672:0@lo:400: 00000100:00100000:2.0:1789049961.581535:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714572544:0@lo:400: 00000100:00100000:0.0:1789049961.581633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572032 00000100:00100000:0.0:1789049961.581638:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572032 00000100:00100000:0.0:1789049961.581677:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789049961.581684:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:3646:x1875954714572032:12345-0@lo:400: 00000100:00100000:0.0:1789049961.581717:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:3646:x1875954714572032:12345-0@lo:400: Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049961.581723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789049961.581756:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714572288:0@lo:400: 00000100:00100000:0.0:1789049961.581783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049961.581808:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714572800:0@lo:400: 00000100:00100000:3.0:1789049961.581814:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572288 00000100:00100000:3.0:1789049961.581820:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572288 00000100:00100000:0.0:1789049961.581834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049961.581852:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049961.581858:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789049961.581863:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714572288:12345-0@lo:400: 00000100:00100000:0.0:1789049961.581867:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714572416:0@lo:400: 00000100:00100000:3.0:1789049961.581908:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714572288:12345-0@lo:400: Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049961.581918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049961.581919:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049961.581974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714572928:0@lo:400: 00000100:00100000:0.0:1789049961.581996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049961.582042:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714572288:0@lo:400: 00000100:00100000:3.0:1789049961.582060:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572928 00000100:00100000:3.0:1789049961.582065:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572928 00000100:00100000:0.0:1789049961.582069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572800 00000100:00100000:0.0:1789049961.582074:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572800 00000100:00100000:3.0:1789049961.582107:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049961.582108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714572416 00000100:00100000:0.0:1789049961.582112:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714572416 00000100:00100000:3.0:1789049961.582117:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714572928:12345-0@lo:400: 00000100:00100000:0.0:1789049961.582130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049961.582139:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714572800:12345-0@lo:400: 00000100:00100000:3.0:1789049961.582159:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714572928:12345-0@lo:400: Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049961.582167:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049961.582183:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714572800:12345-0@lo:400: Request processed in 44us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049961.582191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049961.582204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049961.582209:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714572416:12345-0@lo:400: 00000100:00100000:0.0:1789049961.582234:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714572416:12345-0@lo:400: Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049961.582239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789049961.582255:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789049961.582258:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049961.582261:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789049961.582283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaae70aa00 x1875954714571904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049961.582306:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714571904:0@lo:13: 00000100:00100000:0.0:1789049961.582321:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049961.582327:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714573056:0@lo:13: 00000100:00100000:0.0:1789049961.582363:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789049961.582401:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01880 x1875954714572416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049961.582411:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714572416:0@lo:400: 00010000:00080000:0.0:1789049961.582421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b02680 x1875954714572928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049961.582423:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573056 00000100:00100000:3.0:1789049961.582429:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573056 00000100:00100000:0.0:1789049961.582434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714572928:0@lo:400: 00010000:00080000:0.0:1789049961.582449:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b00e00 x1875954714572800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049961.582458:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714572800:0@lo:400: 00000100:00100000:3.0:1789049961.582472:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049961.582480:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714573056:12345-0@lo:13: 00002000:00000024:3.0:1789049961.582493:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049961.582543:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714573056:12345-0@lo:13: Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049961.582550:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049961.582559:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714572032:0@lo:400: 00010000:00080000:0.0:1789049961.582627:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaae709180 x1875954714573056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049961.582639:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714573056:0@lo:13: 00010000:00010000:0.0:1789049961.586094:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049962.601060:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049963.625373:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049964.649865:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049964.649890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714573184:0@lo:41: 00000100:00100000:3.0:1789049964.649977:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049964.650057:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573184 00000100:00100000:3.0:1789049964.650065:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573184 00000100:00100000:3.0:1789049964.650114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049964.650124:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714573184:12345-0@lo:41: 00000004:00000024:3.0:1789049964.650162:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789049964.650209:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714573184:12345-0@lo:41: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049964.650217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049964.650269:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714573184:0@lo:41: 00010000:00010000:2.0:1789049964.650652:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049965.161880:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049965.161908:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714573312:0@lo:41: 00000100:00100000:3.0:1789049965.162018:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049965.162556:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573312 00000100:00100000:0.0:1789049965.162566:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573312 00000100:00100000:0.0:1789049965.162632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789049965.162642:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714573312:12345-0@lo:41: 00000004:00000024:0.0:1789049965.162682:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789049965.162753:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714573312:12345-0@lo:41: Request processed in 112us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049965.162759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049965.162910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714573312:0@lo:41: 00010000:00010000:1.0:1789049965.675095:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049966.702298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714573696:0@lo:400: 00000100:00100000:2.0:1789049966.702366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049966.702425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714574208:0@lo:400: 00000100:00100000:2.0:1789049966.702632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049966.702664:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789049966.702670:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714573568:0@lo:400: 00000100:00100000:2.0:1789049966.702697:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049966.702714:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714574080:0@lo:400: 00000100:00100000:2.0:1789049966.702733:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049966.702746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714574592:0@lo:400: 00000100:00100000:2.0:1789049966.702769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049966.703035:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049966.703045:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714574720:0@lo:13: 00000100:00100000:3.0:1789049966.703343:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049966.703425:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574720 00000100:00100000:2.0:1789049966.703434:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574720 00000100:00100000:2.0:1789049966.703497:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049966.703508:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714574720:12345-0@lo:13: 00002000:00000024:2.0:1789049966.703540:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049966.703585:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714574720:12345-0@lo:13: Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049966.703592:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789049966.703643:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049966.703676:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227e300 x1875954714574720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049966.703694:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714574720:0@lo:13: 00000100:00100000:0.0:1789049966.703798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714573824:0@lo:400: 00000100:00100000:0.0:1789049966.703841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049966.703869:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714574336:0@lo:400: 00000100:00100000:0.0:1789049966.703901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049966.703931:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789049966.703958:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714573440:0@lo:13: 00000100:00100000:0.0:1789049966.703979:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049966.704007:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714573952:0@lo:400: 00000100:00100000:0.0:1789049966.704029:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049966.704040:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714574464:0@lo:400: 00000100:00100000:0.0:1789049966.704058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049966.704085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573696 00000100:00100000:0.0:1789049966.704089:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573696 00000100:00100000:0.0:1789049966.704114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574208 00000100:00100000:0.0:1789049966.704116:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574208 00000100:00100000:0.0:1789049966.704135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574336 00000100:00100000:0.0:1789049966.704138:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574336 00000100:00100000:0.0:1789049966.704150:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573952 00000100:00100000:0.0:1789049966.704151:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573952 00000100:00100000:0.0:1789049966.704163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049966.704168:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714573696:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704209:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714573696:12345-0@lo:400: Request processed in 40us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049966.704227:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049966.704232:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714574208:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704261:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714574208:12345-0@lo:400: Request processed in 29us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704275:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049966.704287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049966.704293:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714574336:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704323:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714574336:12345-0@lo:400: Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704329:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049966.704340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049966.704346:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714573952:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704370:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714573952:12345-0@lo:400: Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049966.704398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574080 00000100:00100000:0.0:1789049966.704401:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574080 00000100:00100000:0.0:1789049966.704418:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573824 00000100:00100000:0.0:1789049966.704420:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573824 00000100:00100000:0.0:1789049966.704431:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789049966.704436:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714574080:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704468:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714574080:12345-0@lo:400: Request processed in 32us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789049966.704485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789049966.704491:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714573824:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704517:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714573824:12345-0@lo:400: Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789049966.704540:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574592 00000100:00100000:0.0:1789049966.704550:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574592 00000100:00100000:0.0:1789049966.704576:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574464 00000100:00100000:0.0:1789049966.704579:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574464 00000100:00100000:0.0:1789049966.704597:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049966.704602:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714574592:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704633:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714574592:12345-0@lo:400: Request processed in 31us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704638:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049966.704649:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049966.704654:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714574464:12345-0@lo:400: 00000100:00100000:0.0:1789049966.704680:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714574464:12345-0@lo:400: Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704685:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789049966.704713:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049966.704716:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789049966.704718:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789049966.704739:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b00e00 x1875954714573952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.704750:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714573952:0@lo:400: 00010000:00080000:0.0:1789049966.704762:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03480 x1875954714574464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.704769:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714574464:0@lo:400: 00000100:00100000:0.0:1789049966.704778:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714573824:0@lo:400: 00010000:00080000:0.0:1789049966.704787:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03b80 x1875954714574336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.704794:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714574336:0@lo:400: 00000100:00100000:0.0:1789049966.704833:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573440 00000100:00100000:0.0:1789049966.704837:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573440 00000100:00100000:0.0:1789049966.704860:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049966.704867:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714573440:12345-0@lo:13: 00002000:00000024:0.0:1789049966.704880:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049966.704911:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714573440:12345-0@lo:13: Request processed in 46us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049966.704917:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789049966.704965:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7d53b80 x1875954714573440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.704978:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714573440:0@lo:13: 00000100:00100000:0.0:1789049966.705019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714574080:0@lo:400: 00010000:00080000:0.0:1789049966.705029:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01f80 x1875954714574592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.705037:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714574592:0@lo:400: 00010000:00080000:0.0:1789049966.705047:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7d52a00 x1875954714573696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.705055:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714573696:0@lo:400: 00010000:00080000:0.0:1789049966.705065:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01880 x1875954714574208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049966.705073:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714574208:0@lo:400: 00000100:00100000:1.0:1789049966.705260:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714573568 00000100:00100000:1.0:1789049966.705266:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714573568 00000100:00100000:1.0:1789049966.705297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789049966.705305:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:3647:x1875954714573568:12345-0@lo:400: 00000100:00100000:1.0:1789049966.705364:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:3647:x1875954714573568:12345-0@lo:400: Request processed in 60us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049966.705370:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:3.0:1789049966.705668:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049966.705778:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714573568:0@lo:400: 00010000:00010000:0.0:1789049967.721235:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789049967.833867:0:9510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789049967.833871:0:9510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789049967.833878:0:9510:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789049967.834071:0:9510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8baab4394800 00000020:01000004:0.0:1789049967.834089:0:9510:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789049967.834104:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789049967.834118:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8baabd034d40) 00000020:00000080:0.0:1789049967.834135:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789049967.899660:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789049967.899734:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789049967.938303:0:9510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789049967.938526:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789049967.938540:0:9510:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789049967.938552:0:9510:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3b8ec5973df5722c 00000020:01000004:1.0:1789049967.938559:0:9510:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789049967.938580:0:9510:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789049967.938583:0:9510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789049967.938590:0:9510:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789049967.938621:0:9510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789049967.938625:0:9510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789049967.971523:0:9510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789049967.971567:0:9510:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789049967.971572:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789049967.971574:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049967.971575:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049967.971577:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049967.971578:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049967.971579:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049967.971581:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049967.971582:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049967.971584:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049967.971586:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049967.971588:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049967.971591:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789049967.971594:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049967.971595:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049967.971596:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049967.971597:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049967.971598:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049967.971599:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049967.971600:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049967.971601:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049967.971602:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049967.971603:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049967.971604:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049967.971635:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789049967.971655:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714574848:0@lo:253: 00000100:00100000:3.0:1789049967.971740:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.971844:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982435780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049967.971895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574848 00000100:00100000:1.0:1789049967.971904:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574848 00000100:00100000:1.0:1789049967.972621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789049967.972634:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:9510:x1875954714574848:12345-0@lo:253: 20000000:01000000:1.0:1789049967.972671:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789049967.972675:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789049967.972680:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789049967.972691:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789049967.972930:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049967.973308:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789049967.973379:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789049967.973400:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789049967.973406:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789049967.973424:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789049967.973441:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789049967.973528:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789049967.973545:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:1.0:1789049967.973547:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789049967.973560:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789049967.973566:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789049967.973579:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789049967.973585:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:1.0:1789049967.973599:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789049967.973606:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789049967.973620:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789049967.973638:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789049967.973712:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789049967.973723:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:1.0:1789049967.973725:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789049967.973738:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789049967.973743:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789049967.973758:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789049967.973763:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:1.0:1789049967.973782:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789049967.973790:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789049967.973821:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789049967.973841:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789049967.974429:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789049967.974455:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:1.0:1789049967.974457:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789049967.974473:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789049967.974479:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789049967.974492:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789049967.974498:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:1.0:1789049967.974509:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789049967.974516:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789049967.974528:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789049967.974542:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789049967.974554:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789049967.974557:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789049967.974560:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789049967.974600:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789049967.974602:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789049967.975482:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789049967.975704:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789049967.975729:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789049967.975744:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789049967.975755:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789049967.975757:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789049967.976276:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789049967.976299:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789049967.976314:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789049967.976460:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789049967.976480:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789049967.976495:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789049967.976504:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049967.976506:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789049967.976835:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1789049967.976855:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1789049967.976871:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789049967.977245:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789049967.977267:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789049967.977302:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789049967.977313:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789049967.977314:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789049967.977596:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789049967.977617:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789049967.977634:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789049967.977791:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789049967.977811:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789049967.977826:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789049967.977845:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789049967.977846:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789049967.978369:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789049967.978399:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789049967.978410:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789049967.978521:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789049967.978541:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789049967.978551:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1789049967.978561:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789049967.978580:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978595:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978601:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978606:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978609:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978613:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978616:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978620:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978624:0:6512:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978667:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.978679:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 21 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.978745:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714574976:0@lo:104: 00000100:00100000:1.0:1789049967.978862:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.978903:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714574976 00010000:00010000:1.0:1789049967.978909:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049967.978911:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714574976 00010000:00010000:1.0:1789049967.978918:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 21 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.978926:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575104:0@lo:104: 00000100:00100000:1.0:1789049967.978966:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049967.979206:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575104 00000100:00100000:2.0:1789049967.979211:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575104 00010000:00010000:1.0:1789049967.979213:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.979222:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 21 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.979231:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575232:0@lo:104: 00000100:00100000:2.0:1789049967.979235:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049967.979244:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6512:x1875954714574976:12345-0@lo:104: 00000100:00100000:1.0:1789049967.979253:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049967.979258:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049967.979304:0:6502:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789049967.979312:0:6502:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789049967.979409:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.979418:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 21 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.979440:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575360:0@lo:104: 00000100:00100000:0.0:1789049967.979495:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575232 00000100:00100000:0.0:1789049967.979499:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575232 00000100:00100000:3.0:1789049967.979599:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049967.979607:0:9521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+5:6512:x1875954714575104:12345-0@lo:104: 00010000:00010000:3.0:1789049967.979616:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.979676:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049967.979692:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049967.979699:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+5:6512:x1875954714574976:12345-0@lo:104: Request processed in 456us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.979713:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789049967.979784:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049967.979790:0:9521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:6512:x1875954714575104:12345-0@lo:104: Request processed in 184us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049967.979797:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049967.979838:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575360 00000100:00100000:2.0:1789049967.979842:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575360 00000100:00100000:2.0:1789049967.979859:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049967.979864:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6512:x1875954714575232:12345-0@lo:104: 00010000:00010000:2.0:1789049967.979872:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.979907:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049967.979912:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6512:x1875954714575232:12345-0@lo:104: Request processed in 49us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.979918:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789049967.979919:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049967.979925:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.979930:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789049967.979934:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049967.979959:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.979963:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714575360:12345-0@lo:104: 00010000:00010000:1.0:1789049967.979969:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.979970:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980005:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789049967.980010:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714575360:12345-0@lo:104: Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.980016:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789049967.980032:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789049967.980037:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980044:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049967.980048:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980061:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049967.980084:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049967.980091:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049967.980132:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980139:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789049967.980146:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049967.980152:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049967.980158:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980166:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df571ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980177:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049967.980179:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980181:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980186:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049967.980187:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049967.980190:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980192:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980199:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980199:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80030200/0x3b8ec5973df57217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5721e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049967.980205:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980210:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049967.980213:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049967.980216:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049967.980222:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049967.980225:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980229:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980232:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980235:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789049967.980238:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049967.980244:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049967.980248:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980255:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980256:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df571ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980262:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049967.980267:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.980268:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.980270:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.980388:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714575488:0@lo:103: 00000100:00100000:2.0:1789049967.980421:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049967.980435:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980442:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df571a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.980446:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789049967.980451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.980452:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714575616:0@lo:103: 00010000:00010000:1.0:1789049967.980453:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049967.980455:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.980472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049967.980489:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.980494:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714575744:0@lo:103: 00010000:00010000:1.0:1789049967.980500:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 21 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.980515:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.980519:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576000:0@lo:104: 00000100:00100000:2.0:1789049967.980529:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049967.980534:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714575872:0@lo:103: 00000100:00100000:1.0:1789049967.980540:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049967.980563:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.980567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049967.980572:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 21 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.980582:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576128:0@lo:104: 00000100:00100000:1.0:1789049967.980596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575488 00000100:00100000:2.0:1789049967.980599:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575616 00000100:00100000:1.0:1789049967.980600:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575488 00000100:00100000:2.0:1789049967.980601:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575616 00010000:00010000:2.0:1789049967.980618:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 23 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980618:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 23 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.980638:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575744 00000100:00100000:1.0:1789049967.980640:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575744 00000100:00100000:2.0:1789049967.980642:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714575872 00000100:00100000:2.0:1789049967.980644:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714575872 00010000:00010000:1.0:1789049967.980649:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 25 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980654:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 25 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.980660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049967.980666:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049967.980666:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+25:3644:x1875954714575488:12345-0@lo:103: 00000100:00100000:2.0:1789049967.980671:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+25:3644:x1875954714575616:12345-0@lo:103: 00010000:00010000:2.0:1789049967.980676:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049967.980676:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049967.980681:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 25 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.980681:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 25 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980692:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 25 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980708:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049967.980737:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+25:3644:x1875954714575616:12345-0@lo:103: Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.980743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049967.980756:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049967.980763:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714575744:12345-0@lo:103: 00010000:00010000:1.0:1789049967.980763:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 24 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.980771:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049967.980775:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 24 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.980956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049967.981055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576000 00000100:00100000:0.0:1789049967.981060:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576000 00000100:00100000:0.0:1789049967.981087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049967.981094:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576000:12345-0@lo:104: 00010000:00010000:0.0:1789049967.981104:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.981201:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049967.981207:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576000:12345-0@lo:104: Request processed in 114us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049967.981213:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789049967.981275:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 24 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981287:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049967.981331:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714575744:12345-0@lo:103: Request processed in 568us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.981337:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049967.981351:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049967.981358:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714575872:12345-0@lo:103: 00010000:00010000:2.0:1789049967.981365:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049967.981369:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 23 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981377:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 23 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981387:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049967.981399:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049967.981408:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714575872:12345-0@lo:103: Request processed in 51us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.981414:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049967.981425:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+22:3644:x1875954714575488:12345-0@lo:103: Request processed in 760us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.981432:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049967.981453:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714575616:0@lo:103: 00000100:00100000:2.0:1789049967.981461:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714575488:0@lo:103: 00010000:00010000:2.0:1789049967.981482:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049967.981487:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981494:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049967.981495:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049967.981498:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981507:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981522:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:00010000:2.0:1789049967.981524:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981528:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576128 10000000:01000000:2.0:1789049967.981530:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789049967.981531:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576128 00000100:00100000:1.0:1789049967.981550:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789049967.981554:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981555:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576128:12345-0@lo:104: 00010000:00010000:2.0:1789049967.981561:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049967.981562:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981574:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981582:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2042800/0x3b8ec5973df5718b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.981591:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789049967.981594:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789049967.981595:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576128:12345-0@lo:104: Request processed in 41us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1789049967.981597:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981602:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789049967.981604:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049967.981607:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981613:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049967.981619:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049967.981624:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789049967.981633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789049967.981642:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981642:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714576256:0@lo:103: 00010000:00010000:2.0:1789049967.981648:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049967.981653:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981659:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5714c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57153 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049967.981670:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.981671:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.981673:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.981684:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049967.981691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714576384:0@lo:103: 00010000:00010000:1.0:1789049967.981707:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.981715:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.981716:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576256 00000100:00100000:1.0:1789049967.981719:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576256 00010000:00010000:1.0:1789049967.981733:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 22 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.981735:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576384 00000100:00100000:2.0:1789049967.981738:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576384 00010000:00010000:2.0:1789049967.981749:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 23 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049967.981751:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049967.981757:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+23:3645:x1875954714576256:12345-0@lo:103: 00010000:00010000:1.0:1789049967.981763:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789049967.981765:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789049967.981767:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 23 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.981770:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+23:3644:x1875954714576384:12345-0@lo:103: 00010000:00010000:2.0:1789049967.981777:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049967.981780:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 23 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.981789:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 23 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.981834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714575872:0@lo:103: 00000100:00100000:0.0:1789049967.981842:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714575744:0@lo:103: 00010000:00010000:1.0:1789049967.982147:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 23 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.982160:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049967.982193:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+23:3645:x1875954714576256:12345-0@lo:103: Request processed in 436us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.982200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049967.982224:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714576256:0@lo:103: 00010000:00010000:0.0:1789049967.982245:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.982257:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 22 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982282:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae708000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576512:0@lo:104: 00000100:00100000:0.0:1789049967.982308:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049967.982336:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa886936c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789049967.982350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031200/0x3b8ec5973df5721e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57217 expref: 22 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982361:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714574976:0@lo:104: 00010000:00010000:0.0:1789049967.982370:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043200/0x3b8ec5973df571f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df571ed expref: 21 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982379:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575104:0@lo:104: 00010000:00010000:0.0:1789049967.982388:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030800/0x3b8ec5973df571d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df571ca expref: 20 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982394:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575232:0@lo:104: 00010000:00010000:0.0:1789049967.982403:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603c00/0x3b8ec5973df571ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df571a7 expref: 19 pid: 6512 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982410:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714575360:0@lo:104: 00010000:00010000:0.0:1789049967.982417:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5718b expref: 18 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.982426:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576000:0@lo:104: 00000100:00100000:0.0:1789049967.982445:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576128:0@lo:104: 00000100:00100000:1.0:1789049967.982741:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576512 00000100:00100000:1.0:1789049967.982747:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576512 00000100:00100000:1.0:1789049967.982783:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049967.982791:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576512:12345-0@lo:104: 00010000:00010000:1.0:1789049967.982802:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.982925:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049967.982931:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:6512:x1875954714576512:12345-0@lo:104: Request processed in 142us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.982961:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789049967.983029:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049967.983035:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.983049:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049967.983053:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.983061:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049967.983067:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049967.983073:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049967.983105:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.983120:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049967.983135:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983137:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603e00/0x3b8ec5973df57153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5714c expref: 17 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.983142:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2042c00/0x3b8ec5973df57122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57129 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983154:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049967.983157:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049967.983158:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049967.983160:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049967.983171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714576640:0@lo:103: 00000100:00100000:2.0:1789049967.983184:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+16:3644:x1875954714576384:12345-0@lo:103: Request processed in 1414us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.983191:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049967.983195:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049967.983214:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576640 00000100:00100000:2.0:1789049967.983218:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576640 00010000:00010000:2.0:1789049967.983232:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049967.983311:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049967.983398:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+16:3646:x1875954714576640:12345-0@lo:103: 00010000:00010000:2.0:1789049967.983408:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049967.983413:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983422:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983434:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983442:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.983457:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2176200/0x3b8ec5973df57129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57122 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983457:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983465:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049967.983468:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae708000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6512:1875954714576512:0@lo:104: 00010000:00010000:2.0:1789049967.983482:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983489:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983494:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789049967.983498:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983499:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983507:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983516:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.983524:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049967.983549:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714576640:12345-0@lo:103: Request processed in 154us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.983556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049967.983563:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714576640:0@lo:103: 00000100:00100000:2.0:1789049967.983584:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714576384:0@lo:103: 00010000:00010000:2.0:1789049967.984104:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.984123:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.984129:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043400/0x3b8ec5973df57233 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789049967.984170:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789049967.986088:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714574848:0@lo:253: 10000000:01000000:0.0:1789049967.986124:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789049967.986128:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789049967.986130:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789049967.986131:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049967.986133:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789049967.986134:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049967.986135:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049967.986137:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049967.986139:0:9510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789049967.986141:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049967.986142:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789049967.986164:0:9510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8baab4394800 from lustre-OST0001 10000000:01000000:0.0:1789049967.986200:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789049967.986203:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789049967.986212:0:9510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857ab380 local copy 10000000:01000000:0.0:1789049967.986216:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049967.986253:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.986265:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.986274:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.986293:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714576768:0@lo:101: 00000100:00100000:0.0:1789049967.986332:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049967.986446:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049967.986488:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+14:9510:x1875954714574848:12345-0@lo:253: Request processed in 13293us (14183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.986497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789049967.986526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576768 00000100:00100000:2.0:1789049967.986531:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576768 00000100:00100000:1.0:1789049967.986572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789049967.986580:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:9510:x1875954714576768:12345-0@lo:101: 00010000:00010000:1.0:1789049967.986592:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049967.986602:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5723a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.986621:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5723a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.986638:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5723a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.986645:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042e00, rc 0) 00000100:00100000:1.0:1789049967.986676:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714576768:12345-0@lo:101: Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.986680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789049967.986748:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714576768:0@lo:101: 00010000:00010000:0.0:1789049967.986762:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.986780:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049967.986868:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714576896:0@lo:501: 00000100:00100000:0.0:1789049967.986895:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049967.986921:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049967.987000:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714576896 00000100:00100000:1.0:1789049967.987005:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714576896 00000100:00100000:1.0:1789049967.987036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789049967.987043:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714576896:12345-0@lo:501: 00000100:00100000:1.0:1789049967.987117:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714576896:12345-0@lo:501: Request processed in 65us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049967.987125:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789049967.987468:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714576896:0@lo:501: 10000000:01000000:3.0:1789049967.987486:0:9510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789049967.987510:0:9510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789049967.987516:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.987537:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.987546:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.987570:0:9510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789049967.987597:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baab4394800 10000000:01000000:3.0:1789049967.987602:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789049967.987608:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789049967.987611:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049967.987617:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789049967.987619:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789049967.987640:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.987649:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.987657:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049967.987671:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577024:0@lo:101: 00000100:00100000:3.0:1789049967.987706:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049967.987766:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049967.987783:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.987792:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049967.987795:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.987805:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049967.987812:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049967.987817:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049967.987838:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.987845:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049967.987878:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.987887:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df5723a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3b8ec5973df57241 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049967.987912:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.987914:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049967.987916:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.987925:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049967.987957:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714577152:0@lo:103: 00000100:00100000:2.0:1789049967.988002:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.988084:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9821719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049967.988216:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577152 00000100:00100000:1.0:1789049967.988223:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577152 00000100:00100000:1.0:1789049967.988269:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049967.988278:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714577152:12345-0@lo:103: 00010000:00010000:1.0:1789049967.988289:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049967.988302:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df57241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df5723a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049967.988319:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049967.988363:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+14:3646:x1875954714577152:12345-0@lo:103: Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.988371:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049967.988430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714577152:0@lo:103: 00000100:00100000:0.0:1789049967.988566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577024 00000100:00100000:0.0:1789049967.988571:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577024 00000100:00100000:0.0:1789049967.988597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789049967.988603:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+14:9510:x1875954714577024:12345-0@lo:101: 00010000:00010000:0.0:1789049967.988613:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049967.988627:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57248 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.988646:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.988657:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049967.988663:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030200, rc 0) 00000100:00100000:0.0:1789049967.988737:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577024:12345-0@lo:101: Request processed in 133us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049967.988744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789049967.988863:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577024:0@lo:101: 00010000:00010000:3.0:1789049967.988890:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049967.988899:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049967.989274:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577280:0@lo:501: 00000100:00100000:3.0:1789049967.989309:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.989375:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9821719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049967.989411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577280 00000100:00100000:2.0:1789049967.989417:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577280 00000100:00100000:2.0:1789049967.989482:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789049967.989490:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577280:12345-0@lo:501: 00000100:00100000:2.0:1789049967.989604:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577280:12345-0@lo:501: Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049967.989611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789049967.989666:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577280:0@lo:501: 00000100:00100000:3.0:1789049967.989695:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577408:0@lo:503: 00000100:00100000:3.0:1789049967.989740:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.989878:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9821719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049967.990102:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577408 00000100:00100000:0.0:1789049967.990107:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577408 00000100:00100000:0.0:1789049967.990143:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789049967.990150:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577408:12345-0@lo:503: 00000100:00100000:0.0:1789049967.990254:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577408:12345-0@lo:503: Request processed in 103us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049967.990261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789049967.990340:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577408:0@lo:503: 00000040:00080000:3.0:1789049967.990627:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049967.990701:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577536:0@lo:502: 00000100:00100000:3.0:1789049967.990738:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.990777:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9821719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049967.990932:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577536 00000100:00100000:0.0:1789049967.990964:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577536 00000100:00100000:0.0:1789049967.990999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789049967.991006:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577536:12345-0@lo:502: 00000100:00100000:0.0:1789049967.991092:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577536:12345-0@lo:502: Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049967.991099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789049967.991232:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577536:0@lo:502: 00000040:00080000:3.0:1789049967.991416:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789049967.991443:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789049967.991455:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789049967.991481:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789049967.991497:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789049967.991509:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789049967.991531:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577664:0@lo:502: 00000100:00100000:3.0:1789049967.991574:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.991606:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9821719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049967.991692:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577664 00000100:00100000:0.0:1789049967.991698:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577664 00000100:00100000:0.0:1789049967.991719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789049967.991726:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577664:12345-0@lo:502: 00000100:00100000:0.0:1789049967.991815:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577664:12345-0@lo:502: Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049967.991822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789049967.991962:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577664:0@lo:502: 00000040:00080000:3.0:1789049967.992014:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789049967.992024:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789049967.992505:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049967.992514:0:9522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789049967.992520:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049967.992523:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789049967.992529:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049967.992544:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8baaae6e19c0) 00000020:00000080:3.0:1789049967.992569:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789049967.992580:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049967.992667:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baab4394800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789049967.992677:0:9522:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789049967.992684:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3b8ec5973df5725d 00010000:00010000:3.0:1789049967.997905:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789049967.998303:0:9522:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789049968.001281:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789049968.001671:0:9522:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789049968.007928:0:9522:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789049968.008315:0:9522:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789049968.014489:0:9522:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789049968.015931:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789049968.015975:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049968.015991:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049968.015993:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789049968.015996:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049968.016001:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049968.016002:0:9522:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049968.016005:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049968.016007:0:9522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789049968.016030:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049968.016032:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049968.016033:0:9522:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789049968.016037:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789049968.016271:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789049968.016300:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789049968.016323:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.016338:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049968.016347:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab4394800 from 1 10000000:01000000:3.0:1789049968.016349:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049968.016386:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.016400:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.016412:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049968.016439:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577792:0@lo:101: 00000100:00100000:3.0:1789049968.016521:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.016573:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049968.016677:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577792 00000100:00100000:2.0:1789049968.016685:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577792 00000100:00100000:2.0:1789049968.016738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789049968.016749:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:9510:x1875954714577792:12345-0@lo:101: 00010000:00010000:2.0:1789049968.016766:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049968.016779:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57264 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.016804:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.016828:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.016837:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:2.0:1789049968.016878:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714577792:12345-0@lo:101: Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049968.016884:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789049968.017214:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577792:0@lo:101: 00010000:00010000:3.0:1789049968.017231:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.017241:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049968.017338:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577920:0@lo:501: 00000100:00100000:3.0:1789049968.017369:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.017397:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049968.017410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714577920 00000100:00100000:2.0:1789049968.017417:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714577920 00000100:00100000:2.0:1789049968.017453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789049968.017460:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714577920:12345-0@lo:501: 00000100:00100000:2.0:1789049968.017568:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714577920:12345-0@lo:501: Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049968.017575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789049968.017601:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714577920:0@lo:501: 00000100:00100000:3.0:1789049968.017632:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578048:0@lo:503: 00000100:00100000:3.0:1789049968.017671:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.017695:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049968.017795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578048 00000100:00100000:2.0:1789049968.017800:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578048 00000100:00100000:2.0:1789049968.017828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789049968.017835:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578048:12345-0@lo:503: 00000100:00100000:2.0:1789049968.017916:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578048:12345-0@lo:503: Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049968.017923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789049968.019912:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578048:0@lo:503: 00000040:00080000:3.0:1789049968.020229:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049968.020520:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578176:0@lo:502: 00000100:00100000:3.0:1789049968.020663:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.020791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578176 00000100:00100000:0.0:1789049968.020800:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578176 00000100:00100000:0.0:1789049968.020845:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789049968.020853:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578176:12345-0@lo:502: 00000100:00100000:0.0:1789049968.020992:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578176:12345-0@lo:502: Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.021000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789049968.021107:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049968.021122:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578176:0@lo:502: 00000040:00080000:3.0:1789049968.021445:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789049968.021537:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789049968.021684:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578304:0@lo:502: 00000100:00100000:3.0:1789049968.021803:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.021861:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049968.021900:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578304 00000100:00100000:0.0:1789049968.021906:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578304 00000100:00100000:0.0:1789049968.022017:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789049968.022032:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578304:12345-0@lo:502: 00000100:00100000:0.0:1789049968.022126:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578304:12345-0@lo:502: Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.022134:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789049968.022230:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578304:0@lo:502: 00000040:00080000:2.0:1789049968.022290:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789049968.022300:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789049968.024257:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049968.024270:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049968.024286:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789049968.024296:0:9526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baab4394800 00000020:00000080:2.0:1789049968.024299:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789049968.024311:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049968.024314:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049968.024315:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789049968.024318:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789049968.024452:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789049968.024486:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049968.024511:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.024526:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049968.024587:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789049968.024590:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baab4394800 10000000:01000000:3.0:1789049968.024593:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baab4394800 10000000:01000000:3.0:1789049968.024601:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049968.024606:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab4394800 from 1 10000000:01000000:3.0:1789049968.024609:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049968.024648:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.024658:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.024669:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049968.024699:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578432:0@lo:101: 00000100:00100000:3.0:1789049968.024761:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.024848:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049968.025675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578432 00000100:00100000:0.0:1789049968.025849:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578432 00000100:00100000:0.0:1789049968.025911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789049968.025921:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:9510:x1875954714578432:12345-0@lo:101: 00010000:00010000:0.0:1789049968.026285:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049968.026304:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57272 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049968.026410:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049968.026423:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049968.026432:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030800, rc 0) 00000100:00100000:0.0:1789049968.026503:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578432:12345-0@lo:101: Request processed in 583us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.026510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789049968.027047:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578432:0@lo:101: 00010000:00010000:3.0:1789049968.027069:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049968.027080:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049968.027297:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578560:0@lo:501: 00000100:00100000:3.0:1789049968.027347:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.027390:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982171cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049968.027462:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578560 00000100:00100000:0.0:1789049968.027469:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578560 00000100:00100000:0.0:1789049968.027546:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789049968.027555:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578560:12345-0@lo:501: 00000100:00100000:0.0:1789049968.028124:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578560:12345-0@lo:501: Request processed in 567us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.028145:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789049968.028324:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578560:0@lo:501: 00000100:00100000:1.0:1789049968.028393:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578688:0@lo:503: 00000100:00100000:1.0:1789049968.028438:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049968.028462:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049968.028564:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578688 00000100:00100000:0.0:1789049968.028570:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578688 00000100:00100000:0.0:1789049968.028643:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789049968.028652:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578688:12345-0@lo:503: 00000100:00100000:0.0:1789049968.028751:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578688:12345-0@lo:503: Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.028757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789049968.028896:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578688:0@lo:503: 00000040:00080000:1.0:1789049968.029289:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049968.029368:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578816:0@lo:502: 00000100:00100000:1.0:1789049968.029411:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049968.030147:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578816 00000100:00100000:3.0:1789049968.030155:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578816 00000100:00100000:3.0:1789049968.030197:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789049968.030206:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578816:12345-0@lo:502: 00000100:00100000:3.0:1789049968.030321:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578816:12345-0@lo:502: Request processed in 116us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049968.030329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789049968.030857:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049968.030882:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578816:0@lo:502: 00000040:00080000:1.0:1789049968.031145:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789049968.031176:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789049968.031192:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789049968.031206:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789049968.031220:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789049968.031241:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789049968.031257:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789049968.031283:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789049968.031310:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789049968.031341:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789049968.031356:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789049968.031367:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789049968.031379:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789049968.031390:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789049968.031401:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789049968.031414:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789049968.031426:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789049968.031438:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789049968.031451:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789049968.031470:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789049968.031484:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789049968.031495:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789049968.031508:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789049968.031520:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789049968.031544:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789049968.031572:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789049968.031585:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789049968.031595:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789049968.031606:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789049968.031617:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789049968.031628:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789049968.031640:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789049968.031653:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789049968.031666:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789049968.031681:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789049968.031706:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789049968.031722:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789049968.031736:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789049968.031749:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789049968.031760:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789049968.031792:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789049968.031808:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789049968.031823:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789049968.031836:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789049968.031850:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789049968.031864:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789049968.031902:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578944:0@lo:502: 00000100:00100000:1.0:1789049968.032011:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049968.032048:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049968.032652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714578944 00000100:00100000:3.0:1789049968.032662:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714578944 00000100:00100000:3.0:1789049968.032826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789049968.032836:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578944:12345-0@lo:502: 00000100:00100000:3.0:1789049968.033007:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714578944:12345-0@lo:502: Request processed in 173us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049968.033024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789049968.033147:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714578944:0@lo:502: 00000040:00080000:1.0:1789049968.033208:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789049968.033219:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789049968.034576:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789049968.034594:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8baabd17b380) 00000020:00000080:1.0:1789049968.034619:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789049968.034713:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baab4394800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789049968.034718:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baab4394800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789049968.034721:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab4394800 3 00010000:00080000:1.0:1789049968.034751:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba983176800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789049968.039738:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789049968.040077:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789049968.040126:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789049968.040139:0:9527:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3b8ec5973df57287 00000100:00080000:1.0:1789049968.040151:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049968.040164:0:9527:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ba983176800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789049968.040202:0:9527:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba982746680 x1875954714579072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789049968.040232:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789049968.040429:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714579328:0@lo:400: 00000100:00100000:0.0:1789049968.040501:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040533:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714579840:0@lo:400: 00000100:00100000:0.0:1789049968.040570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040593:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789049968.040599:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714579200:0@lo:400: 00000100:00100000:0.0:1789049968.040620:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040635:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714579712:0@lo:400: 00000100:00100000:0.0:1789049968.040652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040676:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714579456:0@lo:400: 00000100:00100000:0.0:1789049968.040697:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040708:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714579968:0@lo:400: 00000100:00100000:0.0:1789049968.040727:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040744:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789049968.040749:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714579584:0@lo:400: 00000100:00100000:0.0:1789049968.040767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040784:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714580096:0@lo:400: 00000100:00100000:0.0:1789049968.040814:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049968.040847:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579328 00000100:00100000:0.0:1789049968.040854:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579328 00000100:00100000:0.0:1789049968.040885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579584 00000100:00100000:0.0:1789049968.040888:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579584 00000100:00100000:0.0:1789049968.040903:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789049968.040912:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714579328:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041001:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714579328:12345-0@lo:400: Request processed in 89us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789049968.041024:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789049968.041030:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714579584:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041062:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714579584:12345-0@lo:400: Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041068:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789049968.041084:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579840 00000100:00100000:0.0:1789049968.041088:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579840 00000100:00100000:0.0:1789049968.041114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579200 00000100:00100000:0.0:1789049968.041117:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579200 00000100:00100000:0.0:1789049968.041128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579712 00000100:00100000:0.0:1789049968.041130:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579712 00000100:00100000:0.0:1789049968.041141:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579456 00000100:00100000:0.0:1789049968.041143:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579456 00000100:00100000:0.0:1789049968.041156:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049968.041161:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714579840:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041188:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714579840:12345-0@lo:400: Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049968.041204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049968.041216:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714579200:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041244:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714579200:12345-0@lo:400: Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049968.041262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049968.041268:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714579712:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041292:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714579712:12345-0@lo:400: Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049968.041308:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049968.041313:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714579456:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041337:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714579456:12345-0@lo:400: Request processed in 24us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041343:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049968.041369:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579968 00000100:00100000:0.0:1789049968.041372:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579968 00000100:00100000:0.0:1789049968.041394:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580096 00000100:00100000:0.0:1789049968.041397:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580096 00000100:00100000:0.0:1789049968.041417:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049968.041422:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714579968:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041449:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714579968:12345-0@lo:400: Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041456:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049968.041467:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049968.041472:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714580096:12345-0@lo:400: 00000100:00100000:0.0:1789049968.041498:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714580096:12345-0@lo:400: Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.041510:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789049968.041532:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049968.041536:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049968.041538:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789049968.041573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714579584:0@lo:400: 00010000:00080000:0.0:1789049968.041586:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03480 x1875954714580096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041595:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714580096:0@lo:400: 00010000:00080000:0.0:1789049968.041602:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01880 x1875954714579456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041609:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714579456:0@lo:400: 00010000:00080000:0.0:1789049968.041617:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b01180 x1875954714579968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041624:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714579968:0@lo:400: 00010000:00080000:0.0:1789049968.041663:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7d53b80 x1875954714579200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041672:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714579200:0@lo:400: 00010000:00080000:0.0:1789049968.041681:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b02680 x1875954714579712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041690:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714579712:0@lo:400: 00000100:00100000:0.0:1789049968.041699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714579328:0@lo:400: 00010000:00080000:0.0:1789049968.041710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03b80 x1875954714579840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.041728:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714579840:0@lo:400: 00000100:00100000:3.0:1789049968.042382:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714579072:0@lo:38: 00000100:00100000:3.0:1789049968.042428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789049968.042887:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789049968.042902:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8baaae6e3380) 00000020:00000080:3.0:1789049968.042927:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789049968.043047:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baab4394800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049968.043051:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baab4394800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049968.043054:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab4394800 3 00010000:00080000:3.0:1789049968.043084:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba98276b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.142@tcp at head 00000100:00080000:1.0:1789049968.043497:0:9528:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8ba982747480 x1875954714580224/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049968.043514:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a06c0 going to sleep for 0 seconds 00000100:00100000:0.0:1789049968.043579:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714579072 00000100:00100000:0.0:1789049968.043587:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714579072 00000100:00100000:0.0:1789049968.044735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049968.044750:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714579072:12345-0@lo:38: 00010000:00080000:0.0:1789049968.044901:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1789049968.045296:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3b8ec5973df57295 00000004:00100000:0.0:1789049968.045316:0:6520:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:3.0:1789049968.045590:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:0.0:1789049968.045632:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8ba98274e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049968.045728:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875954714579072:12345-0@lo:38: Request processed in 979us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.045737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:3.0:1789049968.047189:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789049968.047242:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789049968.047255:0:9527:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x3b8ec5973df5729c 00000100:00080000:3.0:1789049968.047265:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049968.047276:0:9527:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ba98276b800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789049968.047312:0:9527:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba98227ca80 x1875954714580352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049968.047327:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789049968.049299:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714580352:0@lo:38: 00000100:00100000:0.0:1789049968.049393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789049968.049469:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba982746680 x1875954714579072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.049482:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049968.049495:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789049968.049504:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789049968.049511:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789049968.049515:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789049968.049525:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002db14356): req@ffff8ba982747480 x1875954714580224/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049968.049550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714579072:0@lo:38: 00000100:00100000:0.0:1789049968.049603:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580352 00000100:00100000:0.0:1789049968.049610:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580352 00000100:00100000:0.0:1789049968.049649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049968.049659:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714580352:12345-0@lo:38: 00010000:00080000:0.0:1789049968.049690:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1789049968.049733:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x3b8ec5973df572a3 00000004:00100000:0.0:1789049968.049749:0:6518:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789049968.049787:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ba982749000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049968.049856:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875954714580352:12345-0@lo:38: Request processed in 196us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.049866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1789049968.049920:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00010000:00080000:2.0:1789049968.050133:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba98227ca80 x1875954714580352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049968.050141:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049968.050146:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789049968.050151:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789049968.050155:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789049968.050157:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789049968.050163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714580352:0@lo:38: 00000020:01000000:2.0:1789049968.050186:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789049968.050219:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049968.050243:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.050254:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789049968.050316:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789049968.050319:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789049968.050320:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049968.050321:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049968.050322:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049968.050324:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049968.050326:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049968.050327:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049968.050334:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049968.050336:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049968.050337:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049968.050341:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789049968.050343:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049968.050345:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789049968.050346:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049968.050347:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049968.050348:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049968.050349:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049968.050350:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049968.050351:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049968.050353:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049968.050354:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049968.050355:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049968.050373:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789049968.050386:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714580480:0@lo:253: 00000100:00100000:2.0:1789049968.050428:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049968.050459:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580480 00000100:00100000:2.0:1789049968.050464:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580480 00000100:00100000:2.0:1789049968.050497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789049968.050505:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714580480:12345-0@lo:253: 20000000:01000000:2.0:1789049968.050526:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789049968.050540:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789049968.050646:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049968.050919:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049968.053737:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049968.055263:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580224 00000100:00100000:3.0:1789049968.055276:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580224 00000100:00100000:3.0:1789049968.055356:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049968.055366:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875954714580224:12345-0@lo:901: 00000100:00080000:0.0:1789049968.055479:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049968.055746:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875954714580224:12345-0@lo:901: Request processed in 380us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049968.055755:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789049968.055817:0:9528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba982747480 x1875954714580224/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789049984 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049968.055835:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982747480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1875954714580224:0@lo:901: 20000000:01000000:0.0:1789049968.059489:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049968.059515:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789049968.059827:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789049968.059833:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789049968.059857:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.059878:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.059885:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df571df expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.059892:0:6534:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.059964:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.059994:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 17 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049968.060012:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714580608:0@lo:104: 00000100:00100000:0.0:1789049968.060152:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:9510:x1875954714580480:12345-0@lo:253: Request processed in 9646us (9721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049968.060164:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789049968.060223:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049968.060274:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049968.060285:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049968.060295:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714580736:0@lo:104: 00000100:00100000:0.0:1789049968.060319:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049968.060341:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580608 00000100:00100000:1.0:1789049968.060361:0:9521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580608 00000100:00100000:1.0:1789049968.060401:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580736 00000100:00100000:1.0:1789049968.060405:0:9521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580736 00000100:00100000:1.0:1789049968.060418:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049968.060426:0:9521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714580608:12345-0@lo:104: 00010000:00010000:1.0:1789049968.060450:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049968.060505:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049968.060530:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049968.060538:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714580736:12345-0@lo:104: 00010000:00010000:0.0:1789049968.060554:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.060605:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789049968.060683:0:9521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:6534:x1875954714580608:12345-0@lo:104: Request processed in 187us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049968.060691:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789049968.066438:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8839590-fd25-4606-bad2-917c49937107:9510:1875954714580480:0@lo:253: 10000000:01000000:3.0:1789049968.066467:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789049968.066471:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049968.066472:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049968.066474:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049968.066476:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049968.066477:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049968.066478:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049968.066480:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049968.066482:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049968.066483:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049968.066485:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049968.066487:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789049968.066505:0:9510:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789049968.068440:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049968.068456:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049968.068458:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068465:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.068473:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc1287c20) 00010000:00010000:1.0:1789049968.068477:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049968.068482:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068492:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049968.068496:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049968.068509:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.068512:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049968.068521:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:2.0:1789049968.068526:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049968.068533:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789049968.068580:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714580608:0@lo:104: 00010000:00010000:2.0:1789049968.068584:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.068592:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789049968.068599:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1875954714580736:0@lo:104: 00010000:00010000:0.0:1789049968.068610:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:2.0:1789049968.068617:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049968.068625:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:6534:x1875954714580736:12345-0@lo:104: Request processed in 8083us (8300us total) trans 0 rc 0/0 00010000:00010000:2.0:1789049968.068628:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df571df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068639:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049968.068644:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789049968.068646:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049968.068650:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049968.068654:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049968.068669:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714580864:0@lo:103: 00010000:00010000:1.0:1789049968.068682:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068702:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049968.068710:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068718:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031000/0x3b8ec5973df57199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df571a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.068735:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049968.068739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049968.068741:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049968.068742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049968.068798:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049968.068805:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714580992:0@lo:103: 00000100:00100000:2.0:1789049968.068826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049968.069518:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580864 00000100:00100000:1.0:1789049968.069529:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580864 00010000:00010000:1.0:1789049968.069561:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 17 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049968.069594:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714580992 00000100:00100000:1.0:1789049968.069598:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714580992 00010000:00010000:1.0:1789049968.069619:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 18 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049968.069641:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049968.069650:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+18:3644:x1875954714580864:12345-0@lo:103: 00010000:00010000:1.0:1789049968.069663:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049968.069668:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 18 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069679:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 18 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069693:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043600/0x3b8ec5973df571e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df571df expref: 18 pid: 6510 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069719:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049968.069768:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+17:3644:x1875954714580864:12345-0@lo:103: Request processed in 119us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049968.069775:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049968.069791:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049968.069798:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+16:3644:x1875954714580992:12345-0@lo:103: 00010000:00010000:1.0:1789049968.069806:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049968.069811:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069820:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049968.069826:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714580864:0@lo:103: 00010000:00010000:1.0:1789049968.069834:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df571a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57199 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069849:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069857:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789049968.069872:0:7460:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010039807s 00010000:00010000:1.0:1789049968.069877:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069883:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069901:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069920:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069925:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789049968.069928:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069954:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069973:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049968.069999:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049968.070001:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.070020:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049968.070026:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df572aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049968.070034:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+15:3644:x1875954714580992:12345-0@lo:103: Request processed in 235us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049968.070044:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049968.070066:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714580992:0@lo:103: 00080000:10000000:3.0:1789049968.076222:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789049968.076527:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789049968.078099:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789049968.078545:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789049968.078822:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789049968.079238:0:9510:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789049968.081140:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789049968.091135:0:9510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789049968.091149:0:9510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789049968.091202:0:9510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049968.091252:0:9510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049968.091272:0:9510:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789049968.091304:0:9510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789049968.094616:0:9510:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049968.097925:0:9510:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789049968.752895:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789049968.923167:0:9584:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789049968.923404:0:9584:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789049969.770538:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714581120:0@lo:41: 00000100:00100000:1.0:1789049969.770633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049969.770752:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581120 00000100:00100000:1.0:1789049969.770762:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581120 00000100:00100000:1.0:1789049969.770815:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049969.770826:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714581120:12345-0@lo:41: 00000004:00000024:1.0:1789049969.770880:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789049969.770927:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714581120:12345-0@lo:41: Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049969.770964:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049969.771154:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714581120:0@lo:41: 00010000:00010000:1.0:1789049969.771180:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049970.282432:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714581248:0@lo:41: 00000100:00100000:3.0:1789049970.282712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049970.283080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581248 00000100:00100000:1.0:1789049970.283091:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581248 00000100:00100000:1.0:1789049970.283240:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049970.283252:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714581248:12345-0@lo:41: 00000004:00000024:1.0:1789049970.283297:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789049970.283377:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714581248:12345-0@lo:41: Request processed in 127us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049970.283386:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049970.283604:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714581248:0@lo:41: 00010000:00010000:1.0:1789049970.794717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049971.817258:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049971.817285:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714581376:0@lo:13: 00000100:00100000:2.0:1789049971.817356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049971.817484:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581376 00000100:00100000:0.0:1789049971.817493:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581376 00000100:00100000:0.0:1789049971.817550:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049971.817560:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714581376:12345-0@lo:13: 00002000:00000024:0.0:1789049971.817591:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049971.817644:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714581376:12345-0@lo:13: Request processed in 86us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049971.817651:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789049971.817693:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae796300 x1875954714581376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049971.817710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714581376:0@lo:13: 00010000:00010000:0.0:1789049971.818240:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049971.818279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049971.818291:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714581504:0@lo:13: 00000100:00100000:0.0:1789049971.818330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049971.818368:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581504 00000100:00100000:0.0:1789049971.818372:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581504 00000100:00100000:0.0:1789049971.818404:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049971.818411:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714581504:12345-0@lo:13: 00002000:00000024:0.0:1789049971.818424:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049971.818476:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714581504:12345-0@lo:13: Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049971.818483:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789049971.818518:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c3800 x1875954714581504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049971.818533:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714581504:0@lo:13: 00000100:00080000:2.0:1789049971.818613:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789049972.842755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789049972.849149:0:9874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789049973.353374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714581632:0@lo:400: 00000100:00100000:3.0:1789049973.353491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353556:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714582144:0@lo:400: 00000100:00100000:3.0:1789049973.353585:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353604:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714582656:0@lo:400: 00000100:00100000:3.0:1789049973.353641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353670:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789049973.353676:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714581760:0@lo:400: 00000100:00100000:3.0:1789049973.353703:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353720:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714582272:0@lo:400: 00000100:00100000:3.0:1789049973.353740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353755:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714582784:0@lo:400: 00000100:00100000:3.0:1789049973.353774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049973.353806:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581632 00000100:00100000:3.0:1789049973.353815:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581632 00000100:00100000:3.0:1789049973.353868:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789049973.353878:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714581632:12345-0@lo:400: 00000100:00100000:3.0:1789049973.353930:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:3646:x1875954714581632:12345-0@lo:400: Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049973.353967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789049973.354007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582144 00000100:00100000:3.0:1789049973.354011:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582144 00000100:00100000:3.0:1789049973.354051:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049973.354058:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714582144:12345-0@lo:400: 00000100:00100000:3.0:1789049973.354090:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714582144:12345-0@lo:400: Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049973.354096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049973.354143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714581632:0@lo:400: 00000100:00100000:3.0:1789049973.354156:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714582144:0@lo:400: 00000100:00100000:1.0:1789049973.354924:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582656 00000100:00100000:1.0:1789049973.354933:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582656 00000100:00100000:1.0:1789049973.355017:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049973.355025:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714582656:12345-0@lo:400: 00000100:00100000:1.0:1789049973.355089:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714582656:12345-0@lo:400: Request processed in 54us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.355095:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049973.355122:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714582016:0@lo:400: 00000100:00100000:1.0:1789049973.355156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049973.355176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714582528:0@lo:400: 00000100:00100000:1.0:1789049973.355200:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049973.355223:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789049973.355240:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714581888:0@lo:400: 00000100:00100000:1.0:1789049973.355265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049973.355280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714582400:0@lo:400: 00000100:00100000:1.0:1789049973.355301:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049973.355311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714582912:0@lo:400: 00000100:00100000:1.0:1789049973.355330:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049973.355368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581760 00000100:00100000:1.0:1789049973.355373:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581760 00000100:00100000:1.0:1789049973.355393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582272 00000100:00100000:1.0:1789049973.355396:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582272 00000100:00100000:1.0:1789049973.355409:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582784 00000100:00100000:1.0:1789049973.355411:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582784 00000100:00100000:1.0:1789049973.355422:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582016 00000100:00100000:1.0:1789049973.355424:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582016 00000100:00100000:1.0:1789049973.355434:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582400 00000100:00100000:1.0:1789049973.355436:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582400 00000100:00100000:1.0:1789049973.355449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582912 00000100:00100000:1.0:1789049973.355451:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582912 00000100:00100000:1.0:1789049973.355463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789049973.355470:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714581760:12345-0@lo:400: 00000100:00100000:1.0:1789049973.355501:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714581760:12345-0@lo:400: Request processed in 31us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.355508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789049973.355521:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049973.355528:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714582272:12345-0@lo:400: 00000100:00080000:2.0:1789049973.355551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789049973.355557:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714582272:12345-0@lo:400: Request processed in 29us (1815us total) trans 0 rc 0/0 00000100:00080000:2.0:1789049973.355559:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049973.355565:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049973.355569:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049973.355587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789049973.355601:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714582784:12345-0@lo:400: 00000100:00100000:1.0:1789049973.355629:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714582784:12345-0@lo:400: Request processed in 31us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.355635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789049973.355648:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789049973.355654:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714582016:12345-0@lo:400: 00000100:00100000:1.0:1789049973.355684:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714582016:12345-0@lo:400: Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.355691:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789049973.355706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049973.355713:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714582400:12345-0@lo:400: 00010000:00080000:2.0:1789049973.355727:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c2a00 x1875954714582016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049973.355741:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714582400:12345-0@lo:400: Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049973.355743:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714582016:0@lo:400: 00000100:00100000:1.0:1789049973.355755:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049973.355772:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789049973.355777:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c3b80 x1875954714582400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049973.355783:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714582912:12345-0@lo:400: 00000100:00100000:2.0:1789049973.355797:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714582400:0@lo:400: 00000100:00100000:1.0:1789049973.355837:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714582912:12345-0@lo:400: Request processed in 58us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.355844:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049973.355877:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714582528 00000100:00100000:1.0:1789049973.355881:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714582528 00000100:00100000:1.0:1789049973.355906:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049973.355912:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714582528:12345-0@lo:400: 00000100:00100000:3.0:1789049973.356042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714581888 00000100:00100000:3.0:1789049973.356047:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714581888 00010000:00080000:2.0:1789049973.356063:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b02680 x1875954714582912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049973.356075:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714582912:0@lo:400: 00000100:00100000:3.0:1789049973.356080:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789049973.356090:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714581888:12345-0@lo:400: 00000100:00100000:3.0:1789049973.356335:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714581888:12345-0@lo:400: Request processed in 248us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049973.356343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789049973.356381:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c1500 x1875954714581760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049973.356392:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714581760:0@lo:400: 00010000:00080000:3.0:1789049973.356403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c1180 x1875954714582272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049973.356411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714582272:0@lo:400: 00010000:00080000:3.0:1789049973.356422:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b03b80 x1875954714582784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049973.356429:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714582784:0@lo:400: 00010000:00080000:3.0:1789049973.356441:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7d53b80 x1875954714582656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049973.356449:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714582656:0@lo:400: 00000100:00100000:1.0:1789049973.357219:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714582528:12345-0@lo:400: Request processed in 1301us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049973.357230:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789049973.359226:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7d52a00 x1875954714582528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049973.359246:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714582528:0@lo:400: 00000100:00100000:2.0:1789049973.359289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714581888:0@lo:400: 00000100:00080000:2.0:1789049973.359317:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1789049973.668809:0:9926:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789049973.669630:0:9926:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789049973.867035:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049974.889450:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714583040:0@lo:41: 00000100:00100000:2.0:1789049974.889526:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049974.889625:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049974.889725:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583040 00000100:00100000:3.0:1789049974.889735:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583040 00000100:00100000:3.0:1789049974.889789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789049974.889813:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714583040:12345-0@lo:41: 00000004:00000024:3.0:1789049974.889852:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789049974.889914:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714583040:12345-0@lo:41: Request processed in 98us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049974.889921:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049974.890086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714583040:0@lo:41: 00000100:00100000:1.0:1789049975.403626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049975.403655:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714583168:0@lo:41: 00000100:00100000:1.0:1789049975.403727:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049975.403894:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583168 00000100:00100000:2.0:1789049975.403903:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583168 00000100:00100000:2.0:1789049975.403983:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789049975.403994:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714583168:12345-0@lo:41: 00000004:00000024:2.0:1789049975.404033:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789049975.405080:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714583168:12345-0@lo:41: Request processed in 1082us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049975.405090:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789049975.405992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714583168:0@lo:41: 00010000:00010000:1.0:1789049975.913114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789049976.166516:0:10027:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789049976.168567:0:10027:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789049976.937112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049976.937135:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714583296:0@lo:13: 00000100:00100000:0.0:1789049976.937215:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049976.937281:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583296 00000100:00100000:0.0:1789049976.937289:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583296 00000100:00100000:0.0:1789049976.937349:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049976.937359:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714583296:12345-0@lo:13: 00002000:00000024:0.0:1789049976.937391:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049976.937435:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714583296:12345-0@lo:13: Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049976.937442:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789049976.937462:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049976.937492:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01180 x1875954714583296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049976.937510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714583296:0@lo:13: 00000100:00100000:2.0:1789049976.937689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714583424:0@lo:13: 00000100:00100000:2.0:1789049976.937725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049976.937762:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049976.937829:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583424 00000100:00100000:0.0:1789049976.937835:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583424 00000100:00100000:0.0:1789049976.937892:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049976.937899:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714583424:12345-0@lo:13: 00002000:00000024:0.0:1789049976.937910:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049976.938049:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714583424:12345-0@lo:13: Request processed in 149us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049976.938057:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789049976.938076:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049976.938096:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae795180 x1875954714583424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049976.938110:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714583424:0@lo:13: 00000020:00000004:1.0:1789049976.948480:0:10075:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789049976.948493:0:10075:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789049977.409589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049977.410067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056448 00000100:00100000:0.0:1789049977.410082:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056448 00000100:00100000:0.0:1789049977.410144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:0.0:1789049977.410153:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1875954704056448:12345-192.168.203.42@tcp:250: 00010000:00080000:0.0:1789049977.410203:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b05a98b1-94f7-4bce-a081-3983ea0fdaeb@192.168.203.42@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1789049977.410248:0:6512:0:(genops.c:1384:class_connect()) connect: client b05a98b1-94f7-4bce-a081-3983ea0fdaeb, cookie 0x3b8ec5973df572b1 00000100:00080000:0.0:1789049977.410438:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8ba98274d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049977.410525:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+5:2402:x1875954704056448:12345-192.168.203.42@tcp:250: Request processed in 371us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.410534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789049977.432000:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049977.433872:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056576 00000100:00100000:2.0:1789049977.433893:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056576 00000100:00100000:2.0:1789049977.434030:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:2.0:1789049977.434042:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+5:6163:x1875954704056576:12345-192.168.203.42@tcp:101: 00010000:00010000:2.0:1789049977.434061:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049977.434093:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad396691e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.434150:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.434163:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.434173:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176800, rc 0) 00000100:00100000:2.0:1789049977.434255:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+6:6163:x1875954704056576:12345-192.168.203.42@tcp:101: Request processed in 214us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.434267:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:1.0:1789049977.438100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049977.438475:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056704 00000100:00100000:3.0:1789049977.438489:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056704 00000100:00100000:3.0:1789049977.438563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:3.0:1789049977.438575:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+6:6163:x1875954704056704:12345-192.168.203.42@tcp:501: 00000100:00100000:3.0:1789049977.438736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+6:6163:x1875954704056704:12345-192.168.203.42@tcp:501: Request processed in 163us (651us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049977.438744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:3.0:1789049977.440794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049977.440902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056832 00000100:00100000:0.0:1789049977.440914:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056832 00000100:00100000:0.0:1789049977.441017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00100000:0.0:1789049977.441029:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+6:6163:x1875954704056832:12345-192.168.203.42@tcp:101: 00010000:00010000:0.0:1789049977.441047:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049977.441067:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966925 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.441513:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.441528:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.441540:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031200, rc 0) 00000100:00100000:0.0:1789049977.441692:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+7:6163:x1875954704056832:12345-192.168.203.42@tcp:101: Request processed in 664us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.441700:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00100000:0.0:1789049977.445861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049977.446052:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056960 00000100:00100000:2.0:1789049977.446065:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056960 00000100:00100000:2.0:1789049977.446156:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:2.0:1789049977.446167:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+7:6163:x1875954704056960:12345-192.168.203.42@tcp:501: 00000100:00100000:2.0:1789049977.446861:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6163:x1875954704056960:12345-192.168.203.42@tcp:501: Request processed in 693us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.446871:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 146 10000000:01000000:2.0:1789049977.449989:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789049977.450000:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac621000 from 39 10000000:01000000:2.0:1789049977.450008:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049977.450077:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.450094:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.450111:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049977.450165:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583552:0@lo:101: 00000100:00100000:2.0:1789049977.450264:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.450320:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.450634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583552 00000100:00100000:0.0:1789049977.450645:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583552 00000100:00100000:0.0:1789049977.450724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789049977.450735:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714583552:12345-0@lo:101: 00010000:00010000:0.0:1789049977.450753:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049977.450768:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df572c6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.450799:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.450812:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.450821:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031000, rc 0) 00000100:00100000:0.0:1789049977.450878:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714583552:12345-0@lo:101: Request processed in 144us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.450894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789049977.451034:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583552:0@lo:101: 00010000:00010000:2.0:1789049977.451061:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.451080:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049977.451150:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583680:0@lo:501: 00000100:00100000:2.0:1789049977.451181:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.451212:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.451510:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583680 00000100:00100000:0.0:1789049977.451516:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583680 00000100:00100000:0.0:1789049977.451556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789049977.451563:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714583680:12345-0@lo:501: 00000100:00100000:0.0:1789049977.451701:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714583680:12345-0@lo:501: Request processed in 137us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.451707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789049977.451736:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583680:0@lo:501: 00000100:00100000:0.0:1789049977.451765:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583808:0@lo:503: 00000100:00100000:0.0:1789049977.451805:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.451818:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.451828:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583808 00000100:00100000:0.0:1789049977.451832:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583808 00000100:00100000:0.0:1789049977.451847:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789049977.451852:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714583808:12345-0@lo:503: 00000100:00100000:0.0:1789049977.451971:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714583808:12345-0@lo:503: Request processed in 118us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.451978:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789049977.452014:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714583808:0@lo:503: 00000100:00100000:3.0:1789049977.453293:0:10088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10088:1875954714583936:0@lo:502: 00000100:00100000:3.0:1789049977.453374:0:10088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.453415:0:10088:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a956c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.453522:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714583936 00000100:00100000:0.0:1789049977.453529:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714583936 00000100:00100000:0.0:1789049977.453575:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049977.453584:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:10088:x1875954714583936:12345-0@lo:502: 00000100:00100000:0.0:1789049977.453715:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:10088:x1875954714583936:12345-0@lo:502: Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.453729:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049977.454324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049977.454443:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057088 00000100:00100000:3.0:1789049977.454448:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057088 00000100:00100000:1.0:1789049977.454477:0:10088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10088:1875954714583936:0@lo:502: 00000100:00100000:3.0:1789049977.454482:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:3.0:1789049977.454490:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6163:x1875954704057088:12345-192.168.203.42@tcp:503: 00000100:00100000:1.0:1789049977.454554:0:10088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10088:1875954714584064:0@lo:502: 00000100:00100000:3.0:1789049977.454586:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6163:x1875954704057088:12345-192.168.203.42@tcp:503: Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.454593:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:1.0:1789049977.454593:0:10088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.454613:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584064 00000100:00100000:1.0:1789049977.454617:0:10088:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.454621:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584064 00000100:00100000:3.0:1789049977.454637:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789049977.454643:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:10088:x1875954714584064:12345-0@lo:502: 00000100:00100000:3.0:1789049977.454722:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:10088:x1875954714584064:12345-0@lo:502: Request processed in 79us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.454729:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789049977.454797:0:10088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10088:1875954714584064:0@lo:502: 00000040:00080000:1.0:1789049977.454818:0:10088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789049977.455060:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789049977.455087:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049977.455099:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.455112:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049977.455132:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789049977.455135:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789049977.455138:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049977.455165:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.455174:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.455184:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.455197:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584192:0@lo:101: 00000100:00100000:0.0:1789049977.455242:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.455260:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.455559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584192 00000100:00100000:3.0:1789049977.455565:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584192 00000100:00100000:3.0:1789049977.455603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789049977.455610:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714584192:12345-0@lo:101: 00010000:00010000:3.0:1789049977.455620:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049977.455634:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df572d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.455659:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.455669:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.455678:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603800, rc 0) 00000100:00100000:3.0:1789049977.455722:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584192:12345-0@lo:101: Request processed in 113us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.455728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789049977.457235:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584192:0@lo:101: 00010000:00010000:1.0:1789049977.457263:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.457275:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049977.457377:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584320:0@lo:501: 00000100:00100000:3.0:1789049977.457697:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049977.457891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057216 00000100:00100000:0.0:1789049977.457899:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057216 00000100:00100000:0.0:1789049977.457970:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 154 00000100:00100000:0.0:1789049977.457981:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6181:x1875954704057216:12345-192.168.203.42@tcp:502: 00000100:00100000:0.0:1789049977.458239:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6181:x1875954704057216:12345-192.168.203.42@tcp:502: Request processed in 260us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.458248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 154 00000100:00100000:1.0:1789049977.458541:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.458583:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.458688:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584320 00000100:00100000:3.0:1789049977.458693:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584320 00000100:00100000:3.0:1789049977.458734:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789049977.458742:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584320:12345-0@lo:501: 00000100:00100000:3.0:1789049977.458869:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584320:12345-0@lo:501: Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.458875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789049977.459643:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584320:0@lo:501: 00000100:00100000:1.0:1789049977.459698:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584448:0@lo:503: 00000100:00100000:1.0:1789049977.459750:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.459801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584448 00000100:00100000:3.0:1789049977.459807:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584448 00000100:00100000:1.0:1789049977.459814:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.459880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789049977.459894:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584448:12345-0@lo:503: 00000100:00100000:0.0:1789049977.460093:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584448:12345-0@lo:503: Request processed in 201us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.460101:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789049977.460263:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584448:0@lo:503: 00000100:00100000:1.0:1789049977.460874:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10089:1875954714584576:0@lo:502: 00000100:00100000:1.0:1789049977.460931:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.460994:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.461053:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584576 00000100:00100000:2.0:1789049977.461060:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584576 00000100:00100000:2.0:1789049977.461482:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789049977.461492:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:10089:x1875954714584576:12345-0@lo:502: 00000100:00100000:2.0:1789049977.461613:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:10089:x1875954714584576:12345-0@lo:502: Request processed in 123us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.461621:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789049977.461748:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10089:1875954714584576:0@lo:502: 00000020:01000000:3.0:1789049977.461776:0:10089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049977.461787:0:10089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049977.461789:0:10089:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049977.461795:0:10089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049977.461797:0:10089:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789049977.461815:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10089:1875954714584704:0@lo:502: 00000100:00100000:3.0:1789049977.461851:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.461876:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.461933:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584704 00000100:00100000:1.0:1789049977.461965:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584704 00000100:00100000:1.0:1789049977.461990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789049977.461997:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:10089:x1875954714584704:12345-0@lo:502: 00000100:00100000:1.0:1789049977.462440:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:10089:x1875954714584704:12345-0@lo:502: Request processed in 442us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.462447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789049977.462556:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10089:1875954714584704:0@lo:502: 00000020:01000000:3.0:1789049977.462579:0:10089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049977.462584:0:10089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049977.462585:0:10089:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049977.462590:0:10089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789049977.462773:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789049977.462796:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789049977.462807:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.462820:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049977.462838:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789049977.462841:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab0ea0000 from 39 10000000:01000000:2.0:1789049977.462844:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049977.462874:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.462881:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.462890:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049977.462903:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584832:0@lo:101: 00000100:00100000:2.0:1789049977.462980:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.463006:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.463072:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584832 00000100:00100000:1.0:1789049977.463329:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584832 00000100:00100000:1.0:1789049977.463444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789049977.463452:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714584832:12345-0@lo:101: 00010000:00010000:1.0:1789049977.463462:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.463476:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df572e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.463501:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.463527:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.463536:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043200, rc 0) 00000100:00100000:1.0:1789049977.463678:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714584832:12345-0@lo:101: Request processed in 226us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.463684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789049977.467480:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584832:0@lo:101: 00010000:00010000:2.0:1789049977.467523:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.467539:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049977.467651:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584960:0@lo:501: 00000100:00100000:2.0:1789049977.467718:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.467768:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.469071:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714584960 00000100:00100000:0.0:1789049977.469088:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714584960 00000100:00100000:0.0:1789049977.469404:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789049977.469416:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714584960:12345-0@lo:501: 00000100:00100000:0.0:1789049977.469628:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714584960:12345-0@lo:501: Request processed in 215us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.469637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789049977.469742:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714584960:0@lo:501: 00000100:00100000:2.0:1789049977.469799:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585088:0@lo:503: 00000100:00100000:2.0:1789049977.469864:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.470666:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.470909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585088 00000100:00100000:1.0:1789049977.470925:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585088 00000100:00100000:0.0:1789049977.471021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789049977.471032:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714585088:12345-0@lo:503: 00000100:00100000:0.0:1789049977.471376:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714585088:12345-0@lo:503: Request processed in 345us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.471383:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789049977.471448:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585088:0@lo:503: 00000100:00100000:2.0:1789049977.471849:0:10090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10090:1875954714585216:0@lo:502: 00000100:00100000:2.0:1789049977.471887:0:10090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.471906:0:10090:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.472485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585216 00000100:00100000:3.0:1789049977.472492:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585216 00000100:00100000:2.0:1789049977.472610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789049977.472618:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:10090:x1875954714585216:12345-0@lo:502: 00000100:00100000:2.0:1789049977.472832:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:10090:x1875954714585216:12345-0@lo:502: Request processed in 215us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.472841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789049977.474478:0:10090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10090:1875954714585216:0@lo:502: 00000100:00100000:0.0:1789049977.474585:0:10090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10090:1875954714585344:0@lo:502: 00000100:00100000:0.0:1789049977.474660:0:10090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.474765:0:10090:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.474818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585344 00000100:00100000:2.0:1789049977.474826:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585344 00000100:00100000:2.0:1789049977.474929:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789049977.474977:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:10090:x1875954714585344:12345-0@lo:502: 00000100:00100000:2.0:1789049977.475119:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:10090:x1875954714585344:12345-0@lo:502: Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.475128:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789049977.475258:0:10090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10090:1875954714585344:0@lo:502: 00000040:00080000:0.0:1789049977.475297:0:10090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789049977.475615:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789049977.475644:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049977.475655:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.475667:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049977.475689:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789049977.475692:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baab0ea0000 from 6 10000000:01000000:3.0:1789049977.475695:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049977.475725:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.475733:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.475742:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049977.475756:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585472:0@lo:101: 00000100:00100000:3.0:1789049977.475790:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.480378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585472 00000100:00100000:1.0:1789049977.480406:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585472 00000100:00100000:1.0:1789049977.480512:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789049977.480526:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714585472:12345-0@lo:101: 00010000:00010000:1.0:1789049977.480548:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.480585:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2042c00/0x3b8ec5973df572f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df572f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.480624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042c00/0x3b8ec5973df572f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df572f0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.480638:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2042c00/0x3b8ec5973df572f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572f0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.480651:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042c00, rc 0) 00000100:00100000:0.0:1789049977.480736:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8874acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.480743:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714585472:12345-0@lo:101: Request processed in 217us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.480751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789049977.480775:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585472:0@lo:101: 00010000:00010000:0.0:1789049977.480801:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.480813:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.480894:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585600:0@lo:256: 00000100:00100000:0.0:1789049977.481431:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.481511:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.481548:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585600 00000100:00100000:2.0:1789049977.481554:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585600 00000100:00100000:2.0:1789049977.481625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789049977.481635:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714585600:12345-0@lo:256: 20000000:01000000:2.0:1789049977.481655:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789049977.481679:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789049977.481682:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789049977.481775:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714585600:12345-0@lo:256: Request processed in 142us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.481788:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789049977.482787:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585600:0@lo:256: 10000000:01000000:1.0:1789049977.482878:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789049977.482890:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.482903:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049977.482925:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789049977.482928:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789049977.482931:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789049977.483005:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.483014:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.483024:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049977.483045:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585728:0@lo:101: 00000100:00100000:1.0:1789049977.483098:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.483132:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.483316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585728 00000100:00100000:2.0:1789049977.483323:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585728 00000100:00100000:2.0:1789049977.483378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789049977.483388:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714585728:12345-0@lo:101: 00010000:00010000:2.0:1789049977.483400:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049977.483414:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df572fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.483439:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.483450:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049977.483460:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177c00, rc 0) 00000100:00100000:2.0:1789049977.483515:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714585728:12345-0@lo:101: Request processed in 129us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.483521:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789049977.483736:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585728:0@lo:101: 00010000:00010000:0.0:1789049977.483752:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.483762:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.483837:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585856:0@lo:501: 00000100:00100000:0.0:1789049977.483865:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.483891:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.484280:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585856 00000100:00100000:2.0:1789049977.484286:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585856 00000100:00100000:2.0:1789049977.484320:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789049977.484328:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714585856:12345-0@lo:501: 00000100:00100000:2.0:1789049977.484490:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714585856:12345-0@lo:501: Request processed in 161us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.484496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789049977.485283:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585856:0@lo:501: 00000100:00100000:0.0:1789049977.485337:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585984:0@lo:503: 00000100:00100000:0.0:1789049977.485404:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.485440:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.485502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714585984 00000100:00100000:1.0:1789049977.485508:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714585984 00000100:00100000:1.0:1789049977.485553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789049977.485572:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714585984:12345-0@lo:503: 00000100:00100000:1.0:1789049977.485686:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714585984:12345-0@lo:503: Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.485694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789049977.485830:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714585984:0@lo:503: 00000100:00100000:2.0:1789049977.487011:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049977.487248:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10091:1875954714586112:0@lo:502: 00000100:00100000:1.0:1789049977.487312:0:10091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.487452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057344 00000100:00100000:3.0:1789049977.487460:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057344 00000100:00100000:1.0:1789049977.487476:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.492335:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586112 00000100:00100000:1.0:1789049977.492431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:2.0:1789049977.492441:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586112 00000100:00100000:1.0:1789049977.492459:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6181:x1875954704057344:12345-192.168.203.42@tcp:502: 00000100:00100000:2.0:1789049977.492494:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789049977.492503:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10091:x1875954714586112:12345-0@lo:502: 00000100:00100000:1.0:1789049977.492978:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6181:x1875954704057344:12345-192.168.203.42@tcp:502: Request processed in 532us (5972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.492987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:2.0:1789049977.494112:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10091:x1875954714586112:12345-0@lo:502: Request processed in 1602us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.494125:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789049977.494167:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10091:1875954714586112:0@lo:502: 00000020:01000000:1.0:1789049977.494212:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789049977.494221:0:10091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789049977.494231:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049977.494234:0:10091:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789049977.494239:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789049977.494243:0:10091:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:1.0:1789049977.494269:0:10091:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789049977.494272:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049977.494305:0:10091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8baab77f4d40) 00000020:00000080:1.0:1789049977.494337:0:10091:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1789049977.494345:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789049977.494464:0:10091:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789049977.494472:0:10091:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789049977.494480:0:10091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df57313 00010000:00080000:1.0:1789049977.494516:0:10091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab77fc000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789049977.496444:0:10091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1789049977.496632:0:10091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789049977.496647:0:10091:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789049977.497089:0:10091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049977.497219:0:10091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049977.497410:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789049977.497505:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789049977.498032:0:10092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789049977.498039:0:10092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1789049977.498177:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049977.498356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057472 00000100:00100000:1.0:1789049977.498368:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057472 00000100:00100000:1.0:1789049977.498427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:1.0:1789049977.498438:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6163:x1875954704057472:12345-192.168.203.42@tcp:101: 00010000:00010000:1.0:1789049977.498458:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.498482:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df5731a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966956 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.498519:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df5731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966956 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.498532:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df5731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966956 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.498542:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042e00, rc 0) 00000100:00100000:1.0:1789049977.498668:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6163:x1875954704057472:12345-192.168.203.42@tcp:101: Request processed in 231us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.498676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000020:00000080:0.0:1789049977.499852:0:10091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789049977.499868:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789049977.500086:0:10091:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789049977.500124:0:10091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df57321 00000100:00080000:0.0:1789049977.500135:0:10091:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049977.500214:0:10091:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baab77fc000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789049977.500320:0:10091:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba981b01f80 x1875954714586240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789049977.500348:0:10091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789049977.500532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714586368:0@lo:400: 00000100:00100000:1.0:1789049977.500599:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.500635:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714586880:0@lo:400: 00000100:00100000:1.0:1789049977.500662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789049977.500674:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049977.500681:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049977.500684:0:10091:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00100000:1.0:1789049977.500686:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000020:01000000:0.0:1789049977.500689:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1789049977.500694:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714586752:0@lo:400: 00000020:00000080:0.0:1789049977.500695:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049977.500699:0:10091:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049977.500706:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049977.500708:0:10091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789049977.500726:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.500738:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10091:1875954714587392:0@lo:502: 00000100:00100000:1.0:1789049977.500775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714587264:0@lo:400: 00000100:00100000:0.0:1789049977.500797:0:10091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.500805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.500831:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.500848:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714586496:0@lo:400: 00000100:00100000:1.0:1789049977.500875:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.500902:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714587008:0@lo:400: 00000100:00100000:1.0:1789049977.500934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.500968:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789049977.500974:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714586624:0@lo:400: 00000100:00100000:1.0:1789049977.500995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.501004:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714587136:0@lo:400: 00000100:00100000:1.0:1789049977.501021:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.501054:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586368 00000100:00100000:1.0:1789049977.501060:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586368 00000100:00100000:1.0:1789049977.501093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586880 00000100:00100000:1.0:1789049977.501096:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586880 00000100:00100000:1.0:1789049977.501120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587264 00000100:00100000:1.0:1789049977.501123:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587264 00000100:00100000:1.0:1789049977.501136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587008 00000100:00100000:1.0:1789049977.501138:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587008 00000100:00100000:1.0:1789049977.501149:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586624 00000100:00100000:1.0:1789049977.501151:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586624 00000100:00100000:1.0:1789049977.501159:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587136 00000100:00100000:1.0:1789049977.501161:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587136 00000100:00100000:1.0:1789049977.501175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049977.501182:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714586368:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501227:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714586368:12345-0@lo:400: Request processed in 45us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049977.501246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789049977.501258:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714586880:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501282:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714586880:12345-0@lo:400: Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789049977.501296:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789049977.501301:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714587264:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501318:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714587264:12345-0@lo:400: Request processed in 18us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501323:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789049977.501330:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049977.501335:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714587008:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501367:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714587008:12345-0@lo:400: Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049977.501381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049977.501386:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714586624:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501404:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714586624:12345-0@lo:400: Request processed in 19us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049977.501415:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049977.501420:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714587136:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501436:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714587136:12345-0@lo:400: Request processed in 16us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501440:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049977.501459:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586752 00000100:00100000:1.0:1789049977.501462:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586752 00000100:00100000:1.0:1789049977.501482:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586496 00000100:00100000:1.0:1789049977.501484:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586496 00000100:00100000:1.0:1789049977.501494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049977.501498:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714586752:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501524:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714586752:12345-0@lo:400: Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501529:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049977.501537:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789049977.501542:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714586496:12345-0@lo:400: 00000100:00100000:1.0:1789049977.501565:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714586496:12345-0@lo:400: Request processed in 22us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.501570:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789049977.501589:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789049977.501593:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049977.501619:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982744000 x1875954714586624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501632:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714586624:0@lo:400: 00010000:00080000:1.0:1789049977.501641:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982746300 x1875954714587136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501649:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714587136:0@lo:400: 00000100:00100000:1.0:1789049977.501655:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714586496:0@lo:400: 00010000:00080000:1.0:1789049977.501662:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745c00 x1875954714587008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714587008:0@lo:400: 00000100:00100000:1.0:1789049977.501696:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714586752:0@lo:400: 00010000:00080000:1.0:1789049977.501713:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745f80 x1875954714587264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501719:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714587264:0@lo:400: 00010000:00080000:1.0:1789049977.501726:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745180 x1875954714586368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501731:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714586368:0@lo:400: 00010000:00080000:1.0:1789049977.501736:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982746680 x1875954714586880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.501740:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714586880:0@lo:400: 00000100:00100000:2.0:1789049977.502025:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714586240:0@lo:8: 00000100:00100000:2.0:1789049977.502072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.502122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587392 00000100:00100000:2.0:1789049977.502127:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587392 00000100:00100000:2.0:1789049977.502157:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789049977.502164:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10091:x1875954714587392:12345-0@lo:502: 00000100:00100000:2.0:1789049977.502283:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10091:x1875954714587392:12345-0@lo:502: Request processed in 119us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.502289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789049977.502432:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714586240 00000100:00100000:1.0:1789049977.502436:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714586240 00000100:00100000:0.0:1789049977.502466:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10091:1875954714587392:0@lo:502: 00000100:00100000:1.0:1789049977.502469:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049977.502479:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714586240:12345-0@lo:8: 00000020:01000000:0.0:1789049977.502503:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:1.0:1789049977.502508:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1789049977.502512:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049977.502516:0:10091:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789049977.502523:0:10091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:00000080:1.0:1789049977.502541:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df57328 00002000:00100000:1.0:1789049977.502559:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8baab77f8800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789049977.502565:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789049977.502569:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1789049977.502601:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000100:00100000:3.0:1789049977.502603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 10000000:01000000:0.0:1789049977.502640:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00002000:00100000:1.0:1789049977.502646:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:0.0:1789049977.502654:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.502674:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049977.502686:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049977.502689:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac606800 from 39 10000000:01000000:0.0:1789049977.502693:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049977.502728:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.502736:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.502744:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.502761:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714587520:0@lo:101: 00000100:00100000:0.0:1789049977.502798:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.502877:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4a80 going to sleep for 11 seconds 00002000:00080000:1.0:1789049977.503161:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789049977.503191:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8baab77f9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049977.503245:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714586240:12345-0@lo:8: Request processed in 764us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.503252:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789049977.503329:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01f80 x1875954714586240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049977.503339:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049977.503595:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789049977.503606:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789049977.503612:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789049977.503614:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab77fc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789049977.503639:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789049977.503644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714586240:0@lo:8: 00000004:00080000:2.0:1789049977.503680:0:10092:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789049977.503831:0:10092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 199701892382ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789049977.503838:0:10092:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789049977.503863:0:10093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714587648:0@lo:700: 00000100:00100000:0.0:1789049977.503904:0:10093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.503976:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587648 00000100:00100000:0.0:1789049977.503983:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587648 00000100:00100000:0.0:1789049977.504038:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049977.504048:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10093:x1875954714587648:12345-0@lo:700: 00000100:00100000:0.0:1789049977.504084:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1875954714587776:0@lo:700: 00000100:00100000:0.0:1789049977.504120:0:8442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.504139:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.504385:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057600 00000100:00100000:3.0:1789049977.504391:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057600 00000100:00100000:3.0:1789049977.504424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587520 00000100:00100000:3.0:1789049977.504427:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587520 00000100:00100000:0.0:1789049977.504429:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587776 00000100:00100000:0.0:1789049977.504432:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587776 00000100:00100000:3.0:1789049977.504449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00100000:3.0:1789049977.504456:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6163:x1875954704057600:12345-192.168.203.42@tcp:256: 00000100:00100000:0.0:1789049977.504476:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049977.504483:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1875954714587776:12345-0@lo:700: 00000100:00100000:1.0:1789049977.504527:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789049977.504538:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714587520:12345-0@lo:101: 00010000:00010000:1.0:1789049977.504548:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.504568:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5732f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.504585:0:10093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b46c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789049977.504597:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789049977.504598:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 00010000:00010000:1.0:1789049977.504614:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.504624:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:1.0:1789049977.504669:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714587520:12345-0@lo:101: Request processed in 133us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.504675:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789049977.504712:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 20000000:01000000:3.0:1789049977.504764:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789049977.504771:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789049977.504774:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789049977.504784:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789049977.504787:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789049977.504857:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714587520:0@lo:101: 00010000:00010000:0.0:1789049977.504875:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.504886:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.505215:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714587904:0@lo:501: 00000100:00100000:0.0:1789049977.505310:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.505343:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.505353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714587904 00000100:00100000:1.0:1789049977.505359:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714587904 00000100:00100000:1.0:1789049977.505397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789049977.505405:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714587904:12345-0@lo:501: 00000100:00100000:1.0:1789049977.506270:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714587904:12345-0@lo:501: Request processed in 862us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.506281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789049977.506758:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714587904:0@lo:501: 00000100:00100000:3.0:1789049977.506816:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588032:0@lo:503: 00000100:00100000:3.0:1789049977.506863:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.506962:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8874acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.507013:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588032 00000100:00100000:1.0:1789049977.507020:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588032 00000100:00100000:1.0:1789049977.507062:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789049977.507134:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714588032:12345-0@lo:503: 00000100:00100000:1.0:1789049977.507249:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714588032:12345-0@lo:503: Request processed in 179us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.507262:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789049977.507318:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588032:0@lo:503: 00000100:00100000:0.0:1789049977.507588:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6163:x1875954704057600:12345-192.168.203.42@tcp:256: Request processed in 3129us (4984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.507598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 173 00000004:00080000:1.0:1789049977.509422:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789049977.510329:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10094:1875954714588160:0@lo:502: 00000100:00100000:3.0:1789049977.510420:0:10094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.510457:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8874acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.510617:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588160 00000100:00100000:1.0:1789049977.510627:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588160 00000100:00100000:1.0:1789049977.510686:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789049977.510697:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10094:x1875954714588160:12345-0@lo:502: 00000100:00100000:1.0:1789049977.510829:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10094:x1875954714588160:12345-0@lo:502: Request processed in 134us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.510839:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789049977.511059:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10094:1875954714588160:0@lo:502: 00000100:00100000:3.0:1789049977.511112:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10094:1875954714588288:0@lo:502: 00000100:00100000:3.0:1789049977.511216:0:10094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.511332:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.511792:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588288 00000100:00100000:1.0:1789049977.511799:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588288 00000100:00100000:1.0:1789049977.511875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789049977.511884:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:10094:x1875954714588288:12345-0@lo:502: 40000000:02000000:2.0:1789049977.512288:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789049977.512297:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:10094:x1875954714588288:12345-0@lo:502: Request processed in 411us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.512308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789049977.513719:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049977.513804:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057728 00000100:00100000:3.0:1789049977.513815:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057728 00000100:00100000:3.0:1789049977.513972:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:3.0:1789049977.513984:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6163:x1875954704057728:12345-192.168.203.42@tcp:101: 00010000:00010000:3.0:1789049977.514000:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049977.514021:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad396695d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.514029:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10094:1875954714588288:0@lo:502: 00010000:00010000:3.0:1789049977.514066:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.514078:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789049977.514078:0:10094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00010000:00010000:3.0:1789049977.514097:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602200, rc 0) 00000100:00100000:3.0:1789049977.514148:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6163:x1875954704057728:12345-192.168.203.42@tcp:101: Request processed in 167us (437us total) trans 0 rc 0/0 00000020:01000000:0.0:1789049977.514154:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00000100:00100000:3.0:1789049977.514155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 179 10000000:01000000:0.0:1789049977.514177:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049977.514186:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.514196:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049977.514217:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789049977.514221:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8baaac606800 from 6 10000000:01000000:0.0:1789049977.514224:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049977.514254:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.514263:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.514271:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.514291:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588416:0@lo:101: 00000100:00100000:0.0:1789049977.514341:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.514377:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.514397:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588416 00000100:00100000:1.0:1789049977.514402:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588416 00000100:00100000:1.0:1789049977.514435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789049977.514441:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714588416:12345-0@lo:101: 00010000:00010000:1.0:1789049977.514448:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.514459:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5734b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57344 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.514475:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57344 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.514497:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57344 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.514504:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043600, rc 0) 00000100:00100000:1.0:1789049977.514545:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714588416:12345-0@lo:101: Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.514551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789049977.514622:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588416:0@lo:101: 00010000:00010000:0.0:1789049977.514635:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.514646:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.514693:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588544:0@lo:256: 00000100:00100000:0.0:1789049977.514731:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.514753:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.514805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588544 00000100:00100000:1.0:1789049977.514810:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588544 00000100:00100000:1.0:1789049977.514838:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789049977.514845:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714588544:12345-0@lo:256: 20000000:01000000:1.0:1789049977.514859:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049977.514878:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049977.514882:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789049977.515017:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714588544:12345-0@lo:256: Request processed in 171us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.515024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789049977.515132:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588544:0@lo:256: 10000000:01000000:3.0:1789049977.515182:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049977.515188:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.515197:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049977.515205:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789049977.515207:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789049977.515209:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049977.515225:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.515232:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.515239:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049977.515250:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588672:0@lo:101: 00000100:00100000:3.0:1789049977.515278:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.515308:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.516016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588672 00000100:00100000:1.0:1789049977.516023:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588672 00000100:00100000:1.0:1789049977.516062:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789049977.516070:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714588672:12345-0@lo:101: 00010000:00010000:1.0:1789049977.516080:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.516092:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57352 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.516111:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.516133:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.516141:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042800, rc 0) 00000100:00100000:1.0:1789049977.516188:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714588672:12345-0@lo:101: Request processed in 119us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.516194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789049977.516428:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588672:0@lo:101: 00010000:00010000:3.0:1789049977.516442:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049977.516451:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049977.516512:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588800:0@lo:501: 00000100:00100000:3.0:1789049977.516542:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.516571:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.516802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588800 00000100:00100000:0.0:1789049977.516808:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588800 00000100:00100000:0.0:1789049977.516841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789049977.516857:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714588800:12345-0@lo:501: 00000100:00100000:0.0:1789049977.517032:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714588800:12345-0@lo:501: Request processed in 177us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.517040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789049977.517810:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588800:0@lo:501: 00000100:00100000:3.0:1789049977.517883:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588928:0@lo:503: 00000100:00100000:3.0:1789049977.517964:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.517999:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa986a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.518305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714588928 00000100:00100000:1.0:1789049977.518313:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714588928 00000100:00100000:1.0:1789049977.518552:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789049977.518563:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714588928:12345-0@lo:503: 00000100:00100000:1.0:1789049977.518799:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714588928:12345-0@lo:503: Request processed in 238us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.518807:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789049977.518986:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714588928:0@lo:503: 00000100:00100000:0.0:1789049977.520047:0:10095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10095:1875954714589056:0@lo:502: 00000100:00100000:0.0:1789049977.520108:0:10095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.520140:0:10095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ae12480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.520431:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1875954714587776:12345-0@lo:700: Request processed in 15946us (16308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.520441:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049977.520492:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589056 00000100:00100000:1.0:1789049977.520500:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589056 00000100:00100000:1.0:1789049977.520547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789049977.520556:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:10095:x1875954714589056:12345-0@lo:502: 00010000:00080000:0.0:1789049977.520851:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b03b80 x1875954714587776/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.520865:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1875954714587776:0@lo:700: 40000000:02000000:0.0:1789049977.520877:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1789049977.521611:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:10095:x1875954714589056:12345-0@lo:502: Request processed in 1053us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.521621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789049977.522828:0:10095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10095:1875954714589056:0@lo:502: 00000100:00100000:2.0:1789049977.522850:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000020:01000000:3.0:1789049977.522883:0:10095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049977.522893:0:10095:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789049977.522902:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049977.522905:0:10095:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789049977.522911:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789049977.522927:0:10095:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:3.0:1789049977.522979:0:10095:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789049977.522984:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049977.523004:0:10095:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8baaae6e4d40) 00000020:00000080:3.0:1789049977.523036:0:10095:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789049977.523048:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789049977.523167:0:10095:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789049977.523174:0:10095:0:(osd_handler.c:8921:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789049977.523183:0:10095:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df57367 00010000:00080000:3.0:1789049977.523220:0:10095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba982283800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789049977.523485:0:10095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789049977.523675:0:10095:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789049977.523691:0:10095:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789049977.523905:0:10095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049977.523968:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057856 00000100:00100000:1.0:1789049977.523978:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057856 00000100:00100000:1.0:1789049977.524048:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 186 00000100:00100000:1.0:1789049977.524061:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6163:x1875954704057856:12345-192.168.203.42@tcp:501: 00000040:00080000:3.0:1789049977.524087:0:10095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049977.524250:0:10095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789049977.524345:0:10095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1789049977.524640:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6163:x1875954704057856:12345-192.168.203.42@tcp:501: Request processed in 580us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.524656:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 186 00000040:00080000:3.0:1789049977.525336:0:10096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049977.525342:0:10096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789049977.527686:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049977.527929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057984 00000100:00100000:1.0:1789049977.527959:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057984 00000100:00100000:1.0:1789049977.528059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:1.0:1789049977.528071:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6163:x1875954704057984:12345-192.168.203.42@tcp:503: 00000100:00100000:1.0:1789049977.528256:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6163:x1875954704057984:12345-192.168.203.42@tcp:503: Request processed in 187us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.528265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:3.0:1789049977.532123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049977.535304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058112 00000100:00100000:2.0:1789049977.535560:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058112 00000100:00100000:2.0:1789049977.535704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 188 00000100:00100000:2.0:1789049977.535772:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6186:x1875954704058112:12345-192.168.203.42@tcp:502: 00000100:00100000:2.0:1789049977.536447:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6186:x1875954704058112:12345-192.168.203.42@tcp:502: Request processed in 675us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.536457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 188 00000020:00000080:1.0:1789049977.536762:0:10095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789049977.536780:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789049977.536894:0:10095:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789049977.536966:0:10095:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df5736e 00000100:00080000:1.0:1789049977.536977:0:10095:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049977.536986:0:10095:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba982283800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789049977.537022:0:10095:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaa7dd5500 x1875954714589184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789049977.537041:0:10095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789049977.537100:0:10095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049977.537105:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049977.537107:0:10095:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789049977.537111:0:10095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049977.537115:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049977.537116:0:10095:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049977.537119:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049977.537120:0:10095:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789049977.537149:0:10095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10095:1875954714589312:0@lo:502: 00000100:00100000:1.0:1789049977.537216:0:10095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.537260:0:10095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.537448:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714589184:0@lo:8: 00000100:00100000:2.0:1789049977.537484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.537515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589312 00000100:00100000:0.0:1789049977.537521:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589312 00000100:00100000:1.0:1789049977.537560:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589184 00000100:00100000:1.0:1789049977.537564:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589184 00000100:00100000:0.0:1789049977.537564:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789049977.537572:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10095:x1875954714589312:12345-0@lo:502: 00000100:00100000:1.0:1789049977.537739:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049977.537745:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875954714589184:12345-0@lo:8: 00010000:00080000:1.0:1789049977.537770:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1789049977.537798:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df57375 00002000:00100000:1.0:1789049977.537815:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ba98276c000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1789049977.537824:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10095:x1875954714589312:12345-0@lo:502: Request processed in 253us (608us total) trans 0 rc 0/0 00002000:00080000:1.0:1789049977.537831:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1789049977.537832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00002000:00100000:1.0:1789049977.537834:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789049977.537927:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049977.537976:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8ba98276f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049977.538020:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875954714589184:12345-0@lo:8: Request processed in 274us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.538027:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789049977.538106:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd5500 x1875954714589184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.538118:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049977.538126:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789049977.538134:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789049977.538140:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789049977.538143:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba982283800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789049977.538166:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789049977.538172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714589184:0@lo:8: 00000100:00100000:1.0:1789049977.538182:0:10095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10095:1875954714589312:0@lo:502: 00000020:01000000:1.0:1789049977.538205:0:10095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049977.538211:0:10095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049977.538213:0:10095:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789049977.538218:0:10095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:2.0:1789049977.538309:0:10096:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789049977.538383:0:10096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199736445272ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789049977.538391:0:10096:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789049977.538836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049977.539348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058240 00000100:00100000:2.0:1789049977.539357:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058240 00000100:00100000:2.0:1789049977.539410:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789049977.539420:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6186:x1875954704058240:12345-192.168.203.42@tcp:502: 00000100:00100000:2.0:1789049977.539554:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6186:x1875954704058240:12345-192.168.203.42@tcp:502: Request processed in 135us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.539562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:3.0:1789049977.544034:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049977.544085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049977.544198:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058368 00000100:00100000:2.0:1789049977.544211:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058368 00000100:00100000:2.0:1789049977.544249:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058624 00000100:00100000:2.0:1789049977.544252:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058624 00000100:00100000:2.0:1789049977.544267:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789049977.544276:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875954704058368:12345-192.168.203.42@tcp:38: 00010000:00080000:2.0:1789049977.544310:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 199 last 0 00000004:00080000:3.0:1789049977.544538:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:00000080:2.0:1789049977.544888:0:6518:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df5737c 00000004:00100000:2.0:1789049977.544927:0:6518:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000020:01000000:0.0:1789049977.545098:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1789049977.545137:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789049977.545149:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.545162:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049977.545174:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789049977.545177:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857ab380 from 1 10000000:01000000:0.0:1789049977.545180:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049977.545218:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.545227:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.545238:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.545262:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714589440:0@lo:101: 00000100:00080000:2.0:1789049977.545618:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8baab7866000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049977.545731:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.545790:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ae12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.545925:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589440 00000100:00100000:1.0:1789049977.545933:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589440 00000100:00100000:1.0:1789049977.545998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789049977.546007:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714589440:12345-0@lo:101: 00010000:00010000:1.0:1789049977.546018:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049977.546038:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57383 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.546080:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.546092:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.546102:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7c00, rc 0) 00000100:00100000:1.0:1789049977.546151:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714589440:12345-0@lo:101: Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.546157:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789049977.546534:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704058368:12345-192.168.203.42@tcp:38: Request processed in 2256us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.546543:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789049977.546565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789049977.546571:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875954704058624:12345-192.168.203.42@tcp:38: 00010000:00080000:2.0:1789049977.546596:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 199 last 0 00000001:00100000:0.0:1789049977.546874:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789049977.546935:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714589440:0@lo:101: 00010000:00010000:0.0:1789049977.546971:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049977.546997:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049977.547081:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714589568:0@lo:501: 00000100:00100000:0.0:1789049977.547121:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.547160:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ae12e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049977.547220:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10093:x1875954714587648:12345-0@lo:700: Request processed in 43174us (43315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049977.547229:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789049977.547264:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01180 x1875954714587648/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.547276:0:10093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714587648:0@lo:700: 00000020:00000080:2.0:1789049977.547497:0:6518:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df57391 00000004:00100000:2.0:1789049977.547521:0:6518:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00100000:1.0:1789049977.548094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589568 00000100:00100000:1.0:1789049977.548104:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589568 00000100:00100000:1.0:1789049977.548147:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789049977.548155:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714589568:12345-0@lo:501: 00000100:00100000:1.0:1789049977.548276:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714589568:12345-0@lo:501: Request processed in 120us (1153us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049977.548284:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789049977.549125:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714589568:0@lo:501: 10000000:01000000:1.0:1789049977.549176:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789049977.549187:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049977.549199:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789049977.549617:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8baab7867000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049977.549901:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704058624:12345-192.168.203.42@tcp:38: Request processed in 3325us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.549913:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789049977.551577:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714589696:0@lo:13: 00000100:00100000:1.0:1789049977.551758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789049977.551833:0:10097:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789049977.551862:0:10097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714589824:0@lo:7: 00000100:00100000:0.0:1789049977.551893:0:10097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.551958:0:10097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ae12e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.552520:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589696 00000100:00100000:2.0:1789049977.552530:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589696 00000100:00100000:2.0:1789049977.552616:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049977.552627:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714589696:12345-0@lo:13: 00000100:00080000:1.0:1789049977.552728:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789049977.552792:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789049977.552892:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714589696:12345-0@lo:13: Request processed in 266us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.552900:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049977.552952:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589824 00000100:00100000:2.0:1789049977.552956:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589824 00000100:00100000:2.0:1789049977.552985:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049977.552991:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10097:x1875954714589824:12345-0@lo:7: 00010000:00080000:1.0:1789049977.557081:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01180 x1875954714589696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.557115:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714589696:0@lo:13: 00000001:00100000:1.0:1789049977.560610:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000004:00080000:3.0:1789049977.560798:0:10093:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789049977.560829:0:10093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590080:0@lo:7: 00000100:00100000:3.0:1789049977.560928:0:10093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.561001:0:10093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.561056:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714589952:0@lo:13: 00000100:00100000:1.0:1789049977.561092:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.561164:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714589952 00000100:00100000:3.0:1789049977.561173:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714589952 00000100:00100000:2.0:1789049977.561271:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590080 00000100:00100000:2.0:1789049977.561277:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590080 00000100:00100000:2.0:1789049977.561310:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049977.561319:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10093:x1875954714590080:12345-0@lo:7: 00000100:00100000:3.0:1789049977.561358:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049977.561366:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875954714589952:12345-0@lo:13: 00002000:00000024:3.0:1789049977.561378:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789049977.561433:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875954714589952:12345-0@lo:13: Request processed in 68us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.561454:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789049977.561528:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcaa00 x1875954714589952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.561549:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714589952:0@lo:13: 00002000:00080000:3.0:1789049977.566284:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789049977.566294:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789049977.566571:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10097:x1875954714589824:12345-0@lo:7: Request processed in 13573us (14670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.566583:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789049977.566746:0:10097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b03b80 x1875954714589824/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.566764:0:10097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714589824:0@lo:7: 00000004:00080000:0.0:1789049977.566782:0:10097:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789049977.566829:0:10097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590208:0@lo:5: 00000100:00100000:0.0:1789049977.566878:0:10097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.566987:0:10097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ae12e40 going to sleep for 11 seconds 00002000:00080000:2.0:1789049977.567461:0:8629:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789049977.567468:0:8629:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789049977.567624:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10093:x1875954714590080:12345-0@lo:7: Request processed in 6304us (6693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.567633:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049977.567667:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590208 00000100:00100000:2.0:1789049977.567675:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590208 00000100:00100000:3.0:1789049977.567745:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049977.567757:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10097:x1875954714590208:12345-0@lo:5: 00002000:00080000:3.0:1789049977.567785:0:8432:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789049977.567789:0:8432:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1789049977.571022:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcad80 x1875954714590080/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.571046:0:10093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590080:0@lo:7: 00000004:00080000:0.0:1789049977.571064:0:10093:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789049977.571123:0:10093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590336:0@lo:5: 00000100:00100000:0.0:1789049977.571193:0:10093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.571238:0:10093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049977.572052:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590336 00000100:00100000:2.0:1789049977.572062:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590336 00000100:00100000:2.0:1789049977.572117:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049977.572128:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10093:x1875954714590336:12345-0@lo:5: 00002000:00080000:2.0:1789049977.572159:0:8434:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789049977.572226:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10093:x1875954714590336:12345-0@lo:5: Request processed in 100us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049977.572233:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789049977.572822:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcad80 x1875954714590336/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.572838:0:10093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590336:0@lo:5: 00000004:00080000:1.0:1789049977.572853:0:10093:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789049977.572898:0:10093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590464:0@lo:5: 00000100:00100000:1.0:1789049977.573281:0:10093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.573426:0:10093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000001:00080000:0.0:1789049977.574370:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789049977.574390:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789049977.574659:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10097:x1875954714590208:12345-0@lo:5: Request processed in 6901us (7776us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789049977.574669:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049977.574698:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590464 00000100:00100000:3.0:1789049977.574705:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590464 00010000:00080000:0.0:1789049977.574796:0:10097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b03b80 x1875954714590208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.574809:0:10097:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789049977.574814:0:10097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590208:0@lo:5: 00000004:00080000:0.0:1789049977.574830:0:10097:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789049977.574881:0:10097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590592:0@lo:700: 00000100:00100000:0.0:1789049977.574927:0:10097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049977.574987:0:10097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049977.575198:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590592 00000100:00100000:1.0:1789049977.575203:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590592 00000100:00100000:1.0:1789049977.575238:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049977.575247:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10097:x1875954714590592:12345-0@lo:700: 00000100:00100000:2.0:1789049977.575665:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049977.575695:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10093:x1875954714590464:12345-0@lo:5: 00002000:00080000:2.0:1789049977.575730:0:8434:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789049977.578569:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10093:x1875954714590464:12345-0@lo:5: Request processed in 2869us (5280us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789049977.578584:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789049977.578676:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd5500 x1875954714590464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.578695:0:10093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10093:1875954714590464:0@lo:5: 00000004:00080000:1.0:1789049977.578713:0:10093:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789049977.578761:0:10093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10093:1875954714590720:0@lo:900: 00000100:00100000:1.0:1789049977.578812:0:10093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.578842:0:10093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.579190:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590720 00000100:00100000:3.0:1789049977.579198:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590720 00000100:00100000:3.0:1789049977.579251:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049977.579261:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10093:x1875954714590720:12345-0@lo:900: 00010000:00080000:1.0:1789049977.579418:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745180 x1875954714590720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.579429:0:10093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10093:1875954714590720:0@lo:900: 00000100:00100000:3.0:1789049977.579492:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10093:x1875954714590720:12345-0@lo:900: Request processed in 231us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.579499:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:0.0:1789049977.587565:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789049977.588562:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10097:x1875954714590592:12345-0@lo:700: Request processed in 13308us (13627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.588576:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789049977.588791:0:10097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcad80 x1875954714590592/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.588809:0:10097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590592:0@lo:700: 00000001:00100000:3.0:1789049977.590826:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000004:02000040:0.0:1789049977.591037:0:10097:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789049977.596531:0:10097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590848:0@lo:5: 00000100:00100000:1.0:1789049977.596622:0:10097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.596708:0:10097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049977.597021:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590848 00000100:00100000:3.0:1789049977.597031:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590848 00000100:00100000:3.0:1789049977.597109:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049977.597120:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10097:x1875954714590848:12345-0@lo:5: 00002000:00080000:3.0:1789049977.613816:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789049977.613850:0:8433:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789049977.616027:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10097:x1875954714590848:12345-0@lo:5: Request processed in 18900us (19395us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789049977.616043:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789049977.618268:0:10097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745180 x1875954714590848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049977.618296:0:10097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10097:1875954714590848:0@lo:5: 00000004:00080000:2.0:1789049977.618317:0:10097:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789049977.961135:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049978.056174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049978.056222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049978.056260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049978.056329:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058752 00000100:00100000:0.0:1789049978.056333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058496 00000100:00100000:0.0:1789049978.056343:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058496 00000100:00100000:1.0:1789049978.056344:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058752 00000100:00100000:2.0:1789049978.056345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058880 00000100:00100000:2.0:1789049978.056353:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058880 00000100:00100000:1.0:1789049978.056421:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789049978.056433:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:6163:x1875954704058880:12345-192.168.203.42@tcp:41: 00000100:00080000:3.0:1789049978.056454:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789049978.056459:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789049978.056481:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789049978.056581:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:6163:x1875954704058880:12345-192.168.203.42@tcp:41: Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.061840:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789049978.061898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789049978.061933:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704058496:12345-192.168.203.42@tcp:41: 00000004:00000024:1.0:1789049978.061988:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789049978.062981:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704058496:12345-192.168.203.42@tcp:41: Request processed in 1066us (6751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.062991:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789049978.063041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789049978.063052:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704058752:12345-192.168.203.42@tcp:41: 00000004:00000024:1.0:1789049978.063082:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789049978.063121:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704058752:12345-192.168.203.42@tcp:41: Request processed in 71us (6960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.063127:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789049978.069783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049978.070433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059008 00000100:00100000:2.0:1789049978.070446:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059008 00000100:00100000:2.0:1789049978.070523:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789049978.070535:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059008:12345-192.168.203.42@tcp:40: 00000100:00100000:2.0:1789049978.070691:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059008:12345-192.168.203.42@tcp:40: Request processed in 157us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.070700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789049978.078079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049978.078210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049978.078255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049978.078353:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059136 00000100:00100000:0.0:1789049978.078365:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059136 00000100:00100000:0.0:1789049978.078420:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059264 00000100:00100000:0.0:1789049978.078423:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059264 00000100:00100000:0.0:1789049978.078449:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789049978.078460:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875954704059136:12345-192.168.203.42@tcp:8: 00010000:00080000:0.0:1789049978.078501:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789049978.078539:0:8432:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df57398 00002000:00100000:0.0:1789049978.078553:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 615c64c6-0403-4edc-8952-4a12704f5533/ffff8ba98274d800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789049978.078565:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789049978.078801:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789049978.078836:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ba98274b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049978.078921:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704059136:12345-192.168.203.42@tcp:8: Request processed in 451us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.078930:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789049978.078979:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789049978.078984:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875954704059264:12345-192.168.203.42@tcp:8: 00010000:00080000:0.0:1789049978.079002:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789049978.079021:0:8432:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df5739f 00002000:00100000:0.0:1789049978.079026:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 615c64c6-0403-4edc-8952-4a12704f5533/ffff8ba982748000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789049978.079032:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789049978.079201:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789049978.079222:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ba98274f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049978.079247:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704059264:12345-192.168.203.42@tcp:8: Request processed in 261us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.079254:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789049978.083335:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059392 00000100:00100000:3.0:1789049978.083413:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059392 00000100:00100000:3.0:1789049978.084033:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:3.0:1789049978.084542:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059392:12345-192.168.203.42@tcp:900: 00000100:00100000:3.0:1789049978.084664:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059392:12345-192.168.203.42@tcp:900: Request processed in 620us (6599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049978.084673:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789049978.091852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049978.092090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059520 00000100:00100000:3.0:1789049978.092103:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059520 00000100:00100000:3.0:1789049978.092201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:3.0:1789049978.092213:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059520:12345-192.168.203.42@tcp:33: 00000004:00080000:3.0:1789049978.113931:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21606us 00000004:00200000:0.0:1789049978.124084:0:6521:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789049978.124680:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:6163:x1875954704059520:12345-192.168.203.42@tcp:33: Request processed in 32462us (32834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.124697:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789049978.301495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049978.301619:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059648 00000100:00100000:2.0:1789049978.301630:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059648 00000100:00100000:2.0:1789049978.301700:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789049978.301710:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:6204:x1875954704059648:12345-192.168.203.42@tcp:101: 00010000:00010000:2.0:1789049978.301734:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049978.303226:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5e00/0x3b8ec5973df573a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad396698e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.304711:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.304736:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.304753:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049978.306728:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789049978.306739:0:6519:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789049978.306773:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.306827:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5e00/0x3b8ec5973df573a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396698e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.306851:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396698e expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.306862:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa9307b300) 00010000:00010000:2.0:1789049978.306865:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049978.306869:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5000, rc 0) 00000100:00100000:2.0:1789049978.307309:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:6204:x1875954704059648:12345-192.168.203.42@tcp:101: Request processed in 5598us (5823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.307320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00010000:00010000:1.0:1789049978.985552:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049980.009216:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049980.013325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714590976:0@lo:41: 00000100:00100000:0.0:1789049980.013409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049980.013565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714590976 00000100:00100000:1.0:1789049980.013574:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714590976 00000100:00100000:1.0:1789049980.013637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789049980.013648:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714590976:12345-0@lo:41: 00000004:00000024:1.0:1789049980.013691:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789049980.017222:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714590976:12345-0@lo:41: Request processed in 3564us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049980.017249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789049980.026474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714590976:0@lo:41: 00000100:00100000:0.0:1789049980.187452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049980.187532:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059776 00000100:00100000:2.0:1789049980.187544:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059776 00000100:00100000:2.0:1789049980.187630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789049980.187642:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704059776:12345-192.168.203.42@tcp:41: 00000004:00000024:2.0:1789049980.187679:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:3.0:1789049980.187796:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049980.188071:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704059776:12345-192.168.203.42@tcp:41: Request processed in 431us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049980.188080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789049980.196969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049980.197441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059904 00000100:00100000:2.0:1789049980.197455:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059904 00000100:00100000:2.0:1789049980.197583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789049980.197595:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:6256:x1875954704059904:12345-192.168.203.42@tcp:41: 00000004:00000024:2.0:1789049980.197640:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789049980.197739:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:6256:x1875954704059904:12345-192.168.203.42@tcp:41: Request processed in 146us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049980.197747:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00080000:3.0:1789049980.199492:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789049980.202390:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049980.202482:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060032 00000100:00100000:3.0:1789049980.202492:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060032 00000100:00100000:3.0:1789049980.202599:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789049980.202609:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704060032:12345-192.168.203.42@tcp:13: 00002000:00000024:3.0:1789049980.202656:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049980.202739:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704060032:12345-192.168.203.42@tcp:13: Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049980.202747:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00080000:1.0:1789049980.203528:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049980.205316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049980.206189:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060160 00000100:00100000:3.0:1789049980.206201:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060160 00000100:00100000:3.0:1789049980.206320:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:3.0:1789049980.206339:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704060160:12345-192.168.203.42@tcp:13: 00002000:00000024:3.0:1789049980.206372:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049980.206448:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:615c64c6-0403-4edc-8952-4a12704f5533+6:6256:x1875954704060160:12345-192.168.203.42@tcp:13: Request processed in 112us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049980.206455:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00080000:1.0:1789049980.209234:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049980.521369:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049980.521398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714591104:0@lo:41: 00000100:00100000:1.0:1789049980.521485:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049980.522011:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591104 00000100:00100000:2.0:1789049980.522020:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591104 00000100:00100000:2.0:1789049980.522186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049980.522196:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714591104:12345-0@lo:41: 00000004:00000024:2.0:1789049980.522230:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789049980.522295:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714591104:12345-0@lo:41: Request processed in 101us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049980.522312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789049980.522484:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714591104:0@lo:41: 00010000:00010000:0.0:1789049981.033101:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049982.057508:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714591232:0@lo:13: 00000100:00100000:3.0:1789049982.057603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049982.057769:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591232 00000100:00100000:1.0:1789049982.057780:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591232 00000100:00100000:1.0:1789049982.057860:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049982.057874:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714591232:12345-0@lo:13: 00002000:00000024:1.0:1789049982.057919:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049982.058059:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714591360:0@lo:13: 00000100:00100000:2.0:1789049982.058093:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.058126:0:8437:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789049982.058136:0:8437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789049982.058339:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591360 00000100:00100000:2.0:1789049982.058344:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591360 00000100:00100000:2.0:1789049982.058452:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049982.058461:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714591360:12345-0@lo:13: 00002000:00000024:2.0:1789049982.058474:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049982.058509:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714591360:12345-0@lo:13: Request processed in 50us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.058516:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789049982.058560:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794380 x1875954714591360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049982.058581:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714591360:0@lo:13: 00000100:00080000:0.0:1789049982.058983:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049982.059493:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714591232:12345-0@lo:13: Request processed in 1620us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049982.059502:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789049982.059571:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1789049982.059694:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244b480 x1875954714591232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049982.059712:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714591232:0@lo:13: 00000100:00100000:2.0:1789049982.570308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714591488:0@lo:13: 00000100:00100000:2.0:1789049982.570401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.570475:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591488 00000100:00100000:2.0:1789049982.570483:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591488 00000100:00100000:2.0:1789049982.570540:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049982.570550:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714591488:12345-0@lo:13: 00002000:00000024:2.0:1789049982.570580:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049982.570629:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714591488:12345-0@lo:13: Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.570636:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789049982.570658:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789049982.570690:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983569500 x1875954714591488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049982.570711:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714591488:0@lo:13: 00000100:00100000:3.0:1789049982.571775:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714591616:0@lo:13: 00000100:00100000:3.0:1789049982.571916:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049982.572737:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591616 00000100:00100000:1.0:1789049982.572746:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591616 00000100:00100000:1.0:1789049982.572800:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049982.572809:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714591616:12345-0@lo:13: 00002000:00000024:1.0:1789049982.572832:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789049982.572899:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714591616:12345-0@lo:13: Request processed in 91us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049982.572905:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049982.572930:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98356aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714591872:0@lo:400: 00000100:00100000:1.0:1789049982.572982:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049982.573001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714592384:0@lo:400: 00000100:00100000:1.0:1789049982.573036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.573040:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714591744:0@lo:400: 00000100:00100000:1.0:1789049982.573058:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789049982.573068:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714592000:0@lo:400: 00000100:00100000:3.0:1789049982.573082:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.573110:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714592256:0@lo:400: 00000100:00100000:3.0:1789049982.573145:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.573187:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714592768:0@lo:400: 00000100:00100000:3.0:1789049982.573228:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.573601:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591872 00000100:00100000:2.0:1789049982.573615:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591872 00000100:00100000:2.0:1789049982.573646:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592384 00000100:00100000:2.0:1789049982.573648:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592384 00000100:00100000:2.0:1789049982.573661:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592768 00000100:00100000:2.0:1789049982.573663:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592768 00000100:00100000:2.0:1789049982.573678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049982.573685:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714591872:12345-0@lo:400: 00000100:00100000:2.0:1789049982.573729:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714591872:12345-0@lo:400: Request processed in 45us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.573736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049982.573749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049982.573754:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714592384:12345-0@lo:400: 00000100:00100000:2.0:1789049982.573795:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714592384:12345-0@lo:400: Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.573801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049982.573815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789049982.573821:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714592768:12345-0@lo:400: 00000100:00100000:2.0:1789049982.573847:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714592768:12345-0@lo:400: Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.573852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789049982.573873:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789049982.573877:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049982.573896:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049982.574228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714591744 00000100:00100000:2.0:1789049982.574233:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714591744 00000100:00100000:2.0:1789049982.574262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789049982.574268:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714591744:12345-0@lo:400: 00000100:00100000:2.0:1789049982.574297:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714591744:12345-0@lo:400: Request processed in 30us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.574308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789049982.574337:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714592128:0@lo:400: 00000100:00100000:2.0:1789049982.574361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.574379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714592640:0@lo:400: 00000100:00100000:2.0:1789049982.574393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789049982.574420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c0700 x1875954714591616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049982.574430:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789049982.574449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714591616:0@lo:13: 00000100:00100000:2.0:1789049982.574468:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592128 00000100:00100000:2.0:1789049982.574472:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592128 00000100:00100000:2.0:1789049982.574486:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592640 00000100:00100000:2.0:1789049982.574488:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592640 00000100:00100000:2.0:1789049982.574503:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789049982.574508:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714592128:12345-0@lo:400: 00000100:00100000:2.0:1789049982.574539:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714592128:12345-0@lo:400: Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.574545:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789049982.574557:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789049982.574563:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714592640:12345-0@lo:400: 00000100:00100000:2.0:1789049982.574589:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714592640:12345-0@lo:400: Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.574595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789049982.574607:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049982.574624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714592128:0@lo:400: 00000100:00100000:2.0:1789049982.574643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714592640:0@lo:400: 00010000:00080000:3.0:1789049982.575522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983569c00 x1875954714592768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049982.575538:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714592768:0@lo:400: 00000100:00100000:3.0:1789049982.575570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714591744:0@lo:400: 00000100:00100000:3.0:1789049982.575603:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592256 00000100:00100000:3.0:1789049982.575609:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592256 00000100:00100000:3.0:1789049982.575662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049982.575672:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714592256:12345-0@lo:400: 00000100:00100000:3.0:1789049982.575742:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714592256:12345-0@lo:400: Request processed in 71us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049982.575749:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049982.575790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714592256:0@lo:400: 00000100:00100000:1.0:1789049982.577380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.577437:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592000 00000100:00100000:3.0:1789049982.577448:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592000 00000100:00100000:3.0:1789049982.577513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789049982.577524:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714592000:12345-0@lo:400: 00000100:00100000:3.0:1789049982.577597:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714592000:12345-0@lo:400: Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049982.577605:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789049982.579484:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714592000:0@lo:400: 00000100:00100000:1.0:1789049982.579501:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714592512:0@lo:400: 00000100:00100000:1.0:1789049982.579572:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049982.579616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98356aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714591872:0@lo:400: 00000100:00100000:1.0:1789049982.579628:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714592384:0@lo:400: 00000100:00100000:3.0:1789049982.579649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592512 00000100:00100000:3.0:1789049982.579658:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592512 00000100:00080000:0.0:1789049982.579690:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789049982.580258:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789049982.580272:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714592512:12345-0@lo:400: 00000100:00100000:3.0:1789049982.580352:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714592512:12345-0@lo:400: Request processed in 84us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049982.580368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789049982.580626:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98356a300 x1875954714592512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049982.580639:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714592512:0@lo:400: 00000001:02000400:3.0:1789049982.645010:0:10184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789049983.081109:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049983.437609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049983.437654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049983.437698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049983.437704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060416 00000100:00100000:3.0:1789049983.437723:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060416 00000100:00100000:1.0:1789049983.437735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049983.437784:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060672 00000100:00100000:1.0:1789049983.437793:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060672 00000100:00100000:3.0:1789049983.437821:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060544 00000100:00100000:3.0:1789049983.437827:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060544 00000100:00100000:1.0:1789049983.437872:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:3.0:1789049983.437888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789049983.437912:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704060416:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789049983.437913:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:1.0:1789049983.437926:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704060672:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789049983.437961:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704060544:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789049983.438077:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060288 00000100:00100000:2.0:1789049983.438083:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060288 00000100:00100000:2.0:1789049983.438127:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:2.0:1789049983.438135:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2404:x1875954704060288:12345-192.168.203.42@tcp:400: 00000100:00100000:1.0:1789049983.438233:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704060672:12345-192.168.203.42@tcp:400: Request processed in 308us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049983.438242:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789049983.438452:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704060544:12345-192.168.203.42@tcp:400: Request processed in 522us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049983.438460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00080000:0.0:1789049983.438506:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789049983.438512:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049983.438514:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049983.441683:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704060416:12345-192.168.203.42@tcp:400: Request processed in 3765us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049983.441701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:2.0:1789049983.442720:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2404:x1875954704060288:12345-192.168.203.42@tcp:400: Request processed in 4569us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049983.442736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:0.0:1789049983.442794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049983.442849:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060800 00000100:00100000:0.0:1789049983.442862:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060800 00000100:00100000:0.0:1789049983.443013:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00080000:2.0:1789049983.443372:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049983.445218:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704060800:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789049983.445370:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704060800:12345-192.168.203.42@tcp:400: Request processed in 2341us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049983.445383:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000001:00100000:1.0:1789049983.597339:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000001:00100000:0.0:1789049983.597486:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000001:00080000:0.0:1789049983.597498:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1789049984.107429:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049985.129121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714592896:0@lo:41: 00000100:00100000:1.0:1789049985.129197:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049985.129333:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714592896 00000100:00100000:3.0:1789049985.129342:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714592896 00000100:00100000:3.0:1789049985.129405:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789049985.129416:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714592896:12345-0@lo:41: 00000004:00000024:3.0:1789049985.129453:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789049985.129501:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714592896:12345-0@lo:41: Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049985.129508:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049985.129837:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714592896:0@lo:41: 00010000:00010000:1.0:1789049985.129918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789049985.535328:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3cdf23b0 20000000:00000080:1.0:1789049985.535351:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baaae5b4000 uarg=0000000000000000 20000000:01000000:1.0:1789049985.535398:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789049985.535401:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789049985.535404:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789049985.535409:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789049985.535414:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789049985.535470:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789049985.535473:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049985.536147:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789049985.536394:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789049985.536426:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789049985.536441:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789049985.536451:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789049985.536453:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049985.536730:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789049985.537440:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789049985.537473:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789049985.537490:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789049985.537501:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049985.537503:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049985.537815:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789049985.538040:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789049985.538062:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789049985.538079:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789049985.538087:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789049985.538089:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049985.538415:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789049985.538555:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789049985.538577:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789049985.538611:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789049985.538620:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789049985.538623:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049985.538866:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789049985.539030:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789049985.539047:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789049985.539061:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1789049985.539072:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789049985.539092:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539118:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539125:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539134:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539141:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539147:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539154:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539161:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539167:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539173:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539180:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539194:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539201:0:10332:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539241:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539256:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 23 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.539270:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983568a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593024:0@lo:104: 00000100:00100000:1.0:1789049985.539334:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049985.539483:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539492:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 23 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.539500:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983568e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593152:0@lo:104: 00000100:00100000:1.0:1789049985.539521:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049985.539632:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.539639:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.539645:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593280:0@lo:104: 00000100:00100000:1.0:1789049985.539684:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.539708:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593024 00000100:00100000:2.0:1789049985.539716:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593024 00000100:00100000:0.0:1789049985.539764:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593152 00000100:00100000:0.0:1789049985.539768:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593152 00000100:00100000:0.0:1789049985.539806:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049985.539815:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:10332:x1875954714593024:12345-0@lo:104: 00010000:00010000:0.0:1789049985.539828:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.539892:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049985.539899:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:10332:x1875954714593024:12345-0@lo:104: Request processed in 85us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049985.539905:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049985.539923:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049985.539929:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:10332:x1875954714593152:12345-0@lo:104: 00010000:00010000:0.0:1789049985.539962:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.539994:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789049985.539999:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:10332:x1875954714593152:12345-0@lo:104: Request processed in 71us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049985.540005:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789049985.540022:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789049985.540034:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540041:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049985.540045:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540054:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049985.540061:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049985.540066:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049985.540099:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540106:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049985.540125:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540132:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae779000/0x3b8ec5973df57383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5738a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540145:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049985.540147:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540153:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789049985.540155:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540171:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049985.540177:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049985.540183:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049985.540198:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540203:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049985.540220:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540226:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603c00/0x3b8ec5973df57352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57359 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049985.540237:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049985.540239:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049985.540246:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049985.540259:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714593408:0@lo:103: 00000100:00100000:0.0:1789049985.540293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049985.540327:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049985.540335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714593536:0@lo:103: 00000100:00100000:0.0:1789049985.540370:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049985.540400:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593408 00000100:00100000:0.0:1789049985.540404:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593408 00010000:00010000:0.0:1789049985.540423:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 24 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049985.540451:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593536 00000100:00100000:0.0:1789049985.540455:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593536 00010000:00010000:0.0:1789049985.540468:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 25 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049985.540485:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049985.540492:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+25:3647:x1875954714593408:12345-0@lo:103: 00010000:00010000:0.0:1789049985.540503:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049985.540508:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 25 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540519:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 25 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540535:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049985.540564:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+25:3647:x1875954714593408:12345-0@lo:103: Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049985.540570:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049985.540610:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049985.540616:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714593536:12345-0@lo:103: 00010000:00010000:0.0:1789049985.540624:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049985.540628:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 24 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540637:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 24 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049985.540646:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049985.540680:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714593536:12345-0@lo:103: Request processed in 64us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049985.540687:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049985.540727:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714593536:0@lo:103: 00000100:00100000:0.0:1789049985.540753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714593408:0@lo:103: 00010000:00010000:1.0:1789049985.541032:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541043:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 23 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541053:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593664:0@lo:104: 00000100:00100000:1.0:1789049985.541083:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049985.541186:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541195:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541204:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593792:0@lo:104: 00010000:00010000:1.0:1789049985.541229:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541250:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541257:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593920:0@lo:104: 00010000:00010000:1.0:1789049985.541279:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541286:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 23 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541292:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594048:0@lo:104: 00010000:00010000:1.0:1789049985.541335:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541346:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 9 pid: 6512 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541357:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594176:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789049985.541411:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541419:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541427:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594304:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789049985.541450:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541458:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 23 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541466:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594432:0@lo:104: 00010000:00010000:1.0:1789049985.541488:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049985.541496:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541503:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594560:0@lo:104: 00000100:00100000:1.0:1789049985.541518:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00010000:00010000:1.0:1789049985.541538:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df5738a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57383 expref: 23 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541551:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983568a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593024:0@lo:104: 00010000:00010000:1.0:1789049985.541560:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042800/0x3b8ec5973df57359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57352 expref: 22 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.541569:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983568e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593152:0@lo:104: 00000100:00100000:2.0:1789049985.542445:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789049985.542474:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.542492:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.542502:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.542511:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.542519:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.542527:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593280 00000100:00100000:2.0:1789049985.542533:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593280 00000100:00100000:2.0:1789049985.542563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593664 00000100:00100000:2.0:1789049985.542566:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593664 00000100:00100000:2.0:1789049985.542577:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593792 00000100:00100000:2.0:1789049985.542579:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593792 00000100:00100000:2.0:1789049985.542588:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714593920 00000100:00100000:2.0:1789049985.542591:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714593920 00000100:00100000:2.0:1789049985.542599:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594048 00000100:00100000:2.0:1789049985.542601:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594048 00000100:00100000:2.0:1789049985.542610:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594432 00000100:00100000:2.0:1789049985.542612:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594432 00000100:00100000:2.0:1789049985.542620:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594560 00000100:00100000:2.0:1789049985.542631:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594560 00000100:00100000:2.0:1789049985.542649:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049985.542658:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+9:10332:x1875954714593280:12345-0@lo:104: 00010000:00010000:2.0:1789049985.542670:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.542729:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049985.542735:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+9:10332:x1875954714593280:12345-0@lo:104: Request processed in 79us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.542741:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049985.542759:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049985.542764:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+8:10332:x1875954714593664:12345-0@lo:104: 00010000:00010000:2.0:1789049985.542772:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.542803:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049985.542809:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+8:10332:x1875954714593664:12345-0@lo:104: Request processed in 45us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.542814:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049985.542846:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049985.542853:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+7:10332:x1875954714593792:12345-0@lo:104: 00010000:00010000:2.0:1789049985.542869:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.542901:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789049985.542906:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+7:10332:x1875954714593792:12345-0@lo:104: Request processed in 55us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.542911:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049985.542931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049985.542952:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+6:10332:x1875954714593920:12345-0@lo:104: 00010000:00010000:2.0:1789049985.542960:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.542988:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789049985.542992:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+6:10332:x1875954714593920:12345-0@lo:104: Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.542997:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049985.543008:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049985.543013:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+5:10332:x1875954714594048:12345-0@lo:104: 00010000:00010000:2.0:1789049985.543020:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543045:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789049985.543050:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+5:10332:x1875954714594048:12345-0@lo:104: Request processed in 37us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.543055:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049985.543066:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049985.543072:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:10332:x1875954714594432:12345-0@lo:104: 00010000:00010000:2.0:1789049985.543079:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543103:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789049985.543108:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:10332:x1875954714594432:12345-0@lo:104: Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.543114:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049985.543132:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049985.543138:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:10332:x1875954714594560:12345-0@lo:104: 00010000:00010000:2.0:1789049985.543145:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543175:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789049985.543180:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:10332:x1875954714594560:12345-0@lo:104: Request processed in 43us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.543185:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789049985.543210:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789049985.543216:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543223:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543227:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543236:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543243:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543248:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543278:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543284:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543305:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543324:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031400/0x3b8ec5973df5732f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57336 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543338:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789049985.543342:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543348:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543351:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543357:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543364:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543369:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543384:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543390:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543405:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543412:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043400/0x3b8ec5973df572fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57305 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543422:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789049985.543431:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543437:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543440:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543447:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543452:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543457:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543471:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543477:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543482:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543488:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2177600/0x3b8ec5973df572e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543499:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789049985.543502:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543508:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543511:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543529:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543536:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543541:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543554:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543560:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543566:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543572:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80030c00/0x3b8ec5973df572d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543582:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789049985.543585:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543591:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543593:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543600:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543606:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543631:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543645:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543651:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543655:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543662:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2177000/0x3b8ec5973df572c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df572cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543671:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049985.543674:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543680:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543683:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543689:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543695:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543701:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543712:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543717:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543728:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543734:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603600/0x3b8ec5973df57272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57279 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543743:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049985.543746:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543751:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789049985.543754:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543761:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049985.543767:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049985.543772:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049985.543784:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543790:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049985.543793:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543800:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602c00/0x3b8ec5973df57248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5724f expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.543813:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049985.543833:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049985.543835:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049985.543851:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714595072:0@lo:103: 00000100:00100000:2.0:1789049985.543904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.543932:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789049985.543958:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714594688:0@lo:103: 00000100:00100000:2.0:1789049985.543990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714595200:0@lo:103: 00000100:00100000:2.0:1789049985.544028:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544051:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595072 00000100:00100000:2.0:1789049985.544057:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595072 00010000:00010000:2.0:1789049985.544079:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 22 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544100:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594688 00000100:00100000:2.0:1789049985.544103:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594688 00010000:00010000:2.0:1789049985.544113:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595200 00000100:00100000:2.0:1789049985.544129:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595200 00010000:00010000:2.0:1789049985.544140:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 24 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049985.544160:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714595072:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544171:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544176:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 24 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544197:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 24 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544214:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544243:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714595072:12345-0@lo:103: Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049985.544265:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049985.544272:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+23:3644:x1875954714594688:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544280:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544284:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544294:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544304:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544324:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+23:3644:x1875954714594688:12345-0@lo:103: Request processed in 53us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544329:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049985.544341:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049985.544347:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+22:3644:x1875954714595200:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544353:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544358:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 22 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544366:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 22 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544382:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544404:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+22:3644:x1875954714595200:12345-0@lo:103: Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049985.544438:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714594816:0@lo:103: 00000100:00100000:2.0:1789049985.544461:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714595328:0@lo:103: 00000100:00100000:2.0:1789049985.544494:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789049985.544516:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714594944:0@lo:103: 00000100:00100000:2.0:1789049985.544537:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544550:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714595456:0@lo:103: 00000100:00100000:2.0:1789049985.544569:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.544585:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594816 00000100:00100000:2.0:1789049985.544589:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594816 00010000:00010000:2.0:1789049985.544601:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 22 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544613:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595328 00000100:00100000:2.0:1789049985.544616:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595328 00010000:00010000:2.0:1789049985.544624:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 23 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544633:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714594944 00000100:00100000:2.0:1789049985.544635:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714594944 00010000:00010000:2.0:1789049985.544655:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 24 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595456 00000100:00100000:2.0:1789049985.544679:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595456 00010000:00010000:2.0:1789049985.544690:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 25 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.544701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049985.544706:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+25:3646:x1875954714594816:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544713:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544717:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 25 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544725:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 25 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544735:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544760:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+25:3646:x1875954714594816:12345-0@lo:103: Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544766:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049985.544777:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049985.544782:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714595328:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544798:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544802:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 24 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544811:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 24 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544820:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544846:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714595328:12345-0@lo:103: Request processed in 64us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049985.544877:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049985.544884:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714594944:12345-0@lo:103: 00010000:00010000:2.0:1789049985.544890:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.544894:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544903:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 23 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.544912:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.544931:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714594944:12345-0@lo:103: Request processed in 48us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.544961:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049985.544990:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049985.544997:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714595456:12345-0@lo:103: 00010000:00010000:2.0:1789049985.545003:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.545007:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 22 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.545015:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 22 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.545023:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.545042:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714595456:12345-0@lo:103: Request processed in 46us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.545047:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789049985.545088:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049985.545117:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714594944:0@lo:103: 00000100:00100000:2.0:1789049985.545126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714595456:0@lo:103: 00000100:00100000:2.0:1789049985.545132:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714594816:0@lo:103: 00000100:00100000:2.0:1789049985.545138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714595328:0@lo:103: 00000100:00100000:2.0:1789049985.545166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714594688:0@lo:103: 00000100:00100000:2.0:1789049985.545174:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714595200:0@lo:103: 00000100:00100000:2.0:1789049985.545182:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714595072:0@lo:103: 00010000:00010000:2.0:1789049985.545197:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049985.545343:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043e00/0x3b8ec5973df57336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5732f expref: 21 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545357:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593280:0@lo:104: 00010000:00010000:1.0:1789049985.545367:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df57305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df572fe expref: 20 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545376:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593664:0@lo:104: 00010000:00010000:1.0:1789049985.545385:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043200/0x3b8ec5973df572e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df572e2 expref: 19 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545393:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593792:0@lo:104: 00010000:00010000:1.0:1789049985.545402:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603800/0x3b8ec5973df572db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df572d4 expref: 18 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545410:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714593920:0@lo:104: 00010000:00010000:1.0:1789049985.545419:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031000/0x3b8ec5973df572cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df572c6 expref: 17 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545428:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594048:0@lo:104: 00010000:00010000:1.0:1789049985.545438:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030800/0x3b8ec5973df57279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57272 expref: 16 pid: 6512 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545454:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594432:0@lo:104: 00010000:00010000:1.0:1789049985.545466:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030200/0x3b8ec5973df5724f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57248 expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.545474:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594560:0@lo:104: 00000100:00100000:2.0:1789049985.554471:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594176:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789049985.556382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049985.556532:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049985.556581:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875954714594304:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789049985.556640:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.556788:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060928 00000100:00100000:2.0:1789049985.556797:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060928 00010000:00010000:2.0:1789049985.556857:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 10 pid: 6512 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.556904:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061056 00000100:00100000:2.0:1789049985.556907:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061056 00010000:00010000:2.0:1789049985.556920:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 11 pid: 6510 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049985.556967:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789049985.556978:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2403:x1875954704060928:12345-192.168.203.42@tcp:103: 00010000:00010000:2.0:1789049985.557001:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.557008:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 11 pid: 6512 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557036:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 11 pid: 6512 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557055:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031200/0x3b8ec5973df572bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966925 expref: 11 pid: 6512 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557069:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.557123:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2403:x1875954704060928:12345-192.168.203.42@tcp:103: Request processed in 146us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.557131:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789049985.557150:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789049985.557157:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:2403:x1875954704061056:12345-192.168.203.42@tcp:103: 00010000:00010000:2.0:1789049985.557165:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049985.557170:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557180:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557191:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2176800/0x3b8ec5973df572b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396691e expref: 9 pid: 6510 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557203:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557212:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557238:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557245:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557252:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557260:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557271:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789049985.557274:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557283:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557298:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.557306:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049985.557329:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:2403:x1875954704061056:12345-192.168.203.42@tcp:103: Request processed in 172us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.557335:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00010000:00010000:2.0:1789049985.558041:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.558053:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049985.558067:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df573b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049985.644932:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049985.644982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714595584:0@lo:41: 00000100:00100000:1.0:1789049985.645062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049985.645247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595584 00000100:00100000:2.0:1789049985.645256:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595584 00000100:00100000:2.0:1789049985.645311:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789049985.645322:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714595584:12345-0@lo:41: 00000004:00000024:2.0:1789049985.645362:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789049985.645414:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714595584:12345-0@lo:41: Request processed in 95us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049985.645422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049985.645550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714595584:0@lo:41: 00010000:00010000:2.0:1789049986.153213:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049986.921065:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789049986.921073:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab4394800 from 48 10000000:01000000:1.0:1789049986.921078:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049986.921143:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049986.921156:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049986.921167:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049986.921192:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595712:0@lo:101: 00000100:00100000:1.0:1789049986.921274:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.921365:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.921448:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595712 00000100:00100000:0.0:1789049986.921457:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595712 00000100:00100000:0.0:1789049986.921519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789049986.921530:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+15:6515:x1875954714595712:12345-0@lo:101: 00010000:00010000:0.0:1789049986.921547:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049986.921562:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae779600/0x3b8ec5973df573c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df573bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.921589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae779600/0x3b8ec5973df573c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df573bb expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.921612:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae779600/0x3b8ec5973df573c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df573bb expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.921621:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779600, rc 0) 00000100:00100000:0.0:1789049986.921678:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714595712:12345-0@lo:101: Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.921685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789049986.922180:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595712:0@lo:101: 00010000:00010000:1.0:1789049986.922198:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049986.922209:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049986.922899:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595840:0@lo:501: 00000100:00100000:1.0:1789049986.922975:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.923071:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.924240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595840 00000100:00100000:2.0:1789049986.924252:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595840 00000100:00100000:2.0:1789049986.924389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789049986.924401:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714595840:12345-0@lo:501: 00000100:00100000:2.0:1789049986.924611:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714595840:12345-0@lo:501: Request processed in 213us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.924618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789049986.924725:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595840:0@lo:501: 00000100:00100000:1.0:1789049986.924779:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595968:0@lo:503: 00000100:00100000:1.0:1789049986.924836:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.925670:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.925685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714595968 00000100:00100000:3.0:1789049986.925694:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714595968 00000100:00100000:3.0:1789049986.925731:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789049986.925740:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714595968:12345-0@lo:503: 00000100:00100000:3.0:1789049986.925896:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714595968:12345-0@lo:503: Request processed in 156us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.925904:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789049986.927515:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714595968:0@lo:503: 00000100:00100000:1.0:1789049986.929544:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10349:1875954714596096:0@lo:502: 00000100:00100000:1.0:1789049986.929629:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.929679:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.930404:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596096 00000100:00100000:3.0:1789049986.930414:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596096 00000100:00100000:3.0:1789049986.930473:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789049986.930482:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:10349:x1875954714596096:12345-0@lo:502: 00000100:00100000:3.0:1789049986.932009:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+16:10349:x1875954714596096:12345-0@lo:502: Request processed in 1521us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.932022:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789049986.936395:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10349:1875954714596096:0@lo:502: 00000100:00100000:1.0:1789049986.936576:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10349:1875954714596224:0@lo:502: 00000100:00100000:1.0:1789049986.936741:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.936868:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.937020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596224 00000100:00100000:0.0:1789049986.937029:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596224 00000100:00100000:0.0:1789049986.937085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789049986.937114:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:10349:x1875954714596224:12345-0@lo:502: 00000100:00100000:0.0:1789049986.937255:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+16:10349:x1875954714596224:12345-0@lo:502: Request processed in 143us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049986.937287:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10349:1875954714596224:0@lo:502: 00000040:00080000:1.0:1789049986.937316:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1789049986.937365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000020:01000000:2.0:1789049986.937449:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789049986.937475:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049986.937486:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.937498:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049986.937519:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789049986.937522:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789049986.937524:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789049986.937552:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.937560:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.937570:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.937584:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596352:0@lo:101: 00000100:00100000:2.0:1789049986.937614:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.937649:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.937703:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596352 00000100:00100000:0.0:1789049986.937708:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596352 00000100:00100000:0.0:1789049986.937741:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789049986.937749:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+16:6515:x1875954714596352:12345-0@lo:101: 00010000:00010000:0.0:1789049986.937758:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049986.937771:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778c00/0x3b8ec5973df573d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df573c9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.937792:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778c00/0x3b8ec5973df573d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df573c9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.937803:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778c00/0x3b8ec5973df573d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df573c9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.937824:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778c00, rc 0) 00000100:00100000:0.0:1789049986.937872:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596352:12345-0@lo:101: Request processed in 125us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.937878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789049986.938009:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596352:0@lo:101: 00010000:00010000:2.0:1789049986.938023:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.938032:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.938086:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596480:0@lo:501: 00000100:00100000:2.0:1789049986.938121:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.938142:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.938233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596480 00000100:00100000:0.0:1789049986.938238:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596480 00000100:00100000:0.0:1789049986.938254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789049986.938336:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596480:12345-0@lo:501: 00000100:00100000:0.0:1789049986.938884:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596480:12345-0@lo:501: Request processed in 621us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.938904:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789049986.939486:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596480:0@lo:501: 00000100:00100000:2.0:1789049986.939610:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596608:0@lo:503: 00000100:00100000:2.0:1789049986.939677:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.939759:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049986.939803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596608 00000100:00100000:1.0:1789049986.939810:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596608 00000100:00100000:1.0:1789049986.939929:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789049986.940007:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596608:12345-0@lo:503: 00000100:00100000:1.0:1789049986.940235:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596608:12345-0@lo:503: Request processed in 297us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049986.940243:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789049986.940433:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596608:0@lo:503: 00000100:00100000:1.0:1789049986.941020:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10350:1875954714596736:0@lo:502: 00000100:00100000:1.0:1789049986.941069:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.941205:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.941242:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596736 00000100:00100000:3.0:1789049986.941249:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596736 00000100:00100000:3.0:1789049986.941405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789049986.941415:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:10350:x1875954714596736:12345-0@lo:502: 00000100:00100000:3.0:1789049986.941531:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+17:10350:x1875954714596736:12345-0@lo:502: Request processed in 118us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.941538:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789049986.941610:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10350:1875954714596736:0@lo:502: 00000020:01000000:1.0:1789049986.941636:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049986.941644:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049986.941647:0:10350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789049986.941651:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789049986.941673:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10350:1875954714596864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049986.941706:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049986.941773:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.941845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596864 00000100:00100000:0.0:1789049986.941858:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596864 00000100:00100000:0.0:1789049986.941881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789049986.941888:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:10350:x1875954714596864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.941997:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:10350:x1875954714596864:12345-0@lo:502:llog_process_th.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.942004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789049986.942237:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10350:1875954714596864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049986.942268:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049986.942274:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049986.942276:0:10350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789049986.942280:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1789049986.942415:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789049986.942439:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789049986.942450:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.942463:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049986.942473:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789049986.942476:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac621000 from 48 10000000:01000000:3.0:1789049986.942479:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049986.942590:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.942599:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.942608:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049986.942695:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.942732:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.942765:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.943055:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714596992 00000100:00100000:0.0:1789049986.943061:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714596992 00000100:00100000:0.0:1789049986.943100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789049986.943109:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+17:6515:x1875954714596992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049986.943119:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049986.943132:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae779200/0x3b8ec5973df573de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df573d7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.943165:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae779200/0x3b8ec5973df573de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df573d7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.943177:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae779200/0x3b8ec5973df573de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df573d7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.943186:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779200, rc 0) 00000100:00100000:0.0:1789049986.943234:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714596992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.943241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789049986.943366:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714596992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049986.943381:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.943391:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.943451:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.943481:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.943541:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049986.943602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597120 00000100:00100000:1.0:1789049986.943608:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597120 00000100:00100000:1.0:1789049986.943709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789049986.943717:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714597120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.944228:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714597120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.944242:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789049986.944362:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.944395:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.944435:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.944464:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.944528:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597248 00000100:00100000:3.0:1789049986.944534:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597248 00000100:00100000:3.0:1789049986.944571:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789049986.944578:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714597248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.944708:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714597248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.944714:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789049986.946189:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.946812:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10351:1875954714597376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.947487:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.947650:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.947757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597376 00000100:00100000:2.0:1789049986.947767:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597376 00000100:00100000:2.0:1789049986.947860:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789049986.947871:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:10351:x1875954714597376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.948096:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:10351:x1875954714597376:12345-0@lo:502:llog_process_th.0 Request processed in 226us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.948105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789049986.948211:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10351:1875954714597376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.948291:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10351:1875954714597504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.948330:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.951789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597504 00000100:00100000:3.0:1789049986.951802:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597504 00000100:00100000:3.0:1789049986.951867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789049986.951877:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:10351:x1875954714597504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.952163:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+18:10351:x1875954714597504:12345-0@lo:502:llog_process_th.0 Request processed in 287us (3832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.952253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789049986.954447:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049986.954559:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10351:1875954714597504:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789049986.954769:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789049986.955211:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789049986.955239:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049986.955250:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.955262:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049986.955273:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789049986.955275:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789049986.955278:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049986.955317:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.955394:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.955405:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.955427:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.955560:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.956257:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.956290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597632 00000100:00100000:0.0:1789049986.956299:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597632 00000100:00100000:0.0:1789049986.956423:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789049986.956434:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+18:6515:x1875954714597632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049986.956450:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049986.956465:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778e00/0x3b8ec5973df573ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df573e5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.956748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778e00/0x3b8ec5973df573ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df573e5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.956763:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778e00/0x3b8ec5973df573ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df573e5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.956772:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778e00, rc 0) 00000100:00100000:0.0:1789049986.957284:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714597632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 850us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.957292:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789049986.957396:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049986.957413:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.957424:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.957527:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.957563:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.957603:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.957779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597760 00000100:00100000:3.0:1789049986.957786:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597760 00000100:00100000:3.0:1789049986.957835:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789049986.957844:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714597760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.958024:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714597760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.958032:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789049986.958188:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.958219:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.958260:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.958296:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa91a689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.958704:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714597888 00000100:00100000:2.0:1789049986.958710:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714597888 00000100:00100000:2.0:1789049986.958747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789049986.958755:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714597888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.959342:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714597888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 585us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.959351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789049986.959459:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714597888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.961281:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10352:1875954714598016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.961354:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.961397:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.961623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598016 00000100:00100000:3.0:1789049986.961632:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598016 00000100:00100000:3.0:1789049986.961682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789049986.961692:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:10352:x1875954714598016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.961821:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+19:10352:x1875954714598016:12345-0@lo:502:llog_process_th.0 Request processed in 129us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.961828:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789049986.962106:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10352:1875954714598016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049986.962134:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049986.962144:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049986.962146:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789049986.962163:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789049986.962184:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10352:1875954714598144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.962220:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.962248:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.962347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598144 00000100:00100000:0.0:1789049986.962352:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598144 00000100:00100000:0.0:1789049986.962385:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789049986.962392:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:10352:x1875954714598144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.962521:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:10352:x1875954714598144:12345-0@lo:502:llog_process_th.0 Request processed in 129us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.962528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789049986.962751:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10352:1875954714598144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049986.962769:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049986.962773:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049986.962781:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789049986.962785:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789049986.963222:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789049986.963242:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049986.963252:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.963263:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049986.963274:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049986.963276:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baab0ea0000 from 48 10000000:01000000:0.0:1789049986.963279:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049986.963306:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.963315:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.963333:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049986.963349:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.963393:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.963427:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.963568:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598272 00000100:00100000:2.0:1789049986.963574:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598272 00000100:00100000:2.0:1789049986.963611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789049986.963627:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+19:6515:x1875954714598272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049986.963636:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049986.963648:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a5400/0x3b8ec5973df573fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df573f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.963670:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a5400/0x3b8ec5973df573fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df573f3 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.963682:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a5400/0x3b8ec5973df573fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df573f3 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.963689:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5400, rc 0) 00000100:00100000:2.0:1789049986.963733:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.963740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789049986.965353:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049986.965378:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.965390:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049986.965473:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.965521:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.965552:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.966073:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598400 00000100:00100000:2.0:1789049986.966081:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598400 00000100:00100000:2.0:1789049986.966122:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789049986.966131:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.966317:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.966325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789049986.966524:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.966562:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.966606:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.966760:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.966832:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598528 00000100:00100000:0.0:1789049986.966837:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598528 00000100:00100000:0.0:1789049986.966881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789049986.966888:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.967240:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 351us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.967247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789049986.967399:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.970290:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10353:1875954714598656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.970437:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.970522:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.970736:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598656 00000100:00100000:2.0:1789049986.970744:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598656 00000100:00100000:2.0:1789049986.970802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789049986.970811:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:10353:x1875954714598656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.971264:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:10353:x1875954714598656:12345-0@lo:502:llog_process_th.0 Request processed in 452us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.971272:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789049986.971405:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10353:1875954714598656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.971458:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10353:1875954714598784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.971681:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.971716:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.971762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598784 00000100:00100000:2.0:1789049986.971767:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598784 00000100:00100000:2.0:1789049986.971799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789049986.971806:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10353:x1875954714598784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.972243:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+20:10353:x1875954714598784:12345-0@lo:502:llog_process_th.0 Request processed in 436us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.972251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789049986.972313:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10353:1875954714598784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789049986.972397:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789049986.972788:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789049986.972812:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049986.972899:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.972910:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049986.972920:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789049986.972922:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789049986.972925:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789049986.973298:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.973309:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.973319:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049986.973349:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.973393:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.973457:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82e73840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.974232:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714598912 00000100:00100000:2.0:1789049986.974241:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714598912 00000100:00100000:2.0:1789049986.974336:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789049986.974347:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714598912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049986.974363:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049986.974378:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a5600/0x3b8ec5973df57408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57401 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.974403:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a5600/0x3b8ec5973df57408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57401 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.974414:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a5600/0x3b8ec5973df57408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57401 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.974422:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5600, rc 0) 00000100:00100000:2.0:1789049986.974477:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714598912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.974502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789049986.974591:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714598912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049986.974607:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.974625:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049986.974696:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.974727:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.975383:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82e73840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.975473:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599040 00000100:00100000:0.0:1789049986.975480:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599040 00000100:00100000:0.0:1789049986.975521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789049986.975529:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714599040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.975675:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714599040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.975683:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789049986.975928:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.975993:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.976044:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.976064:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82e73840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.976294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599168 00000100:00100000:0.0:1789049986.976300:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599168 00000100:00100000:0.0:1789049986.976330:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789049986.976337:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714599168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.976434:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714599168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.976441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789049986.976526:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.977055:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10354:1875954714599296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.977093:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.977122:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82e73840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.977270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599296 00000100:00100000:0.0:1789049986.977275:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599296 00000100:00100000:0.0:1789049986.977298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789049986.977304:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10354:x1875954714599296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.977397:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10354:x1875954714599296:12345-0@lo:502:llog_process_th.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.977404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789049986.977574:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10354:1875954714599296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049986.977600:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049986.977609:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049986.977612:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789049986.977628:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789049986.977649:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10354:1875954714599424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.977682:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.977711:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.977761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599424 00000100:00100000:0.0:1789049986.977766:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599424 00000100:00100000:0.0:1789049986.977784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789049986.977789:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10354:x1875954714599424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.977884:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10354:x1875954714599424:12345-0@lo:502:llog_process_th.0 Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.977890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789049986.978078:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10354:1875954714599424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049986.978096:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049986.978101:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049986.978103:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789049986.978106:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789049986.978357:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789049986.978377:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789049986.978385:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.978397:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049986.978419:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049986.978421:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baaac606800 from 48 10000000:01000000:0.0:1789049986.978424:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049986.978449:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.978457:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.978465:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049986.978480:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.978522:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.978557:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.978729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599552 00000100:00100000:3.0:1789049986.978735:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599552 00000100:00100000:3.0:1789049986.978759:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789049986.978767:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714599552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049986.978777:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049986.978803:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602e00/0x3b8ec5973df57416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5740f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.978837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602e00/0x3b8ec5973df57416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5740f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.978858:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602e00/0x3b8ec5973df57416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5740f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.978866:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602e00, rc 0) 00000100:00100000:3.0:1789049986.978907:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714599552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.978913:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789049986.979092:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049986.979105:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.979115:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049986.979177:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.979203:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.979223:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.979373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599680 00000100:00100000:3.0:1789049986.979379:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599680 00000100:00100000:3.0:1789049986.979398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789049986.979403:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714599680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.979524:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714599680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.979541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789049986.979730:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.979759:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.979803:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.979832:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.979924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599808 00000100:00100000:3.0:1789049986.979928:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599808 00000100:00100000:3.0:1789049986.979968:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789049986.979974:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714599808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.980250:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714599808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.980256:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789049986.980565:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714599808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.981418:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10355:1875954714599936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.981476:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.981706:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.981735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714599936 00000100:00100000:0.0:1789049986.981741:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714599936 00000100:00100000:0.0:1789049986.981821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789049986.981831:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:10355:x1875954714599936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.982009:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:10355:x1875954714599936:12345-0@lo:502:llog_process_th.0 Request processed in 178us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.982017:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789049986.982321:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10355:1875954714599936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.982371:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10355:1875954714600064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.982410:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.982608:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.982678:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600064 00000100:00100000:2.0:1789049986.982684:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600064 00000100:00100000:2.0:1789049986.982711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789049986.982718:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:10355:x1875954714600064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049986.982820:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:10355:x1875954714600064:12345-0@lo:502:llog_process_th.0 Request processed in 92us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.982828:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789049986.982971:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10355:1875954714600064:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789049986.983001:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789049986.983272:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789049986.983292:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049986.983303:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.983315:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049986.983325:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789049986.983328:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789049986.983331:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049986.983358:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.983367:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.983377:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.983392:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.983430:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.983454:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.983507:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600192 00000100:00100000:3.0:1789049986.983512:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600192 00000100:00100000:3.0:1789049986.983534:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789049986.983540:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714600192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049986.983550:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049986.983561:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603000/0x3b8ec5973df57424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5741d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.983595:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603000/0x3b8ec5973df57424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5741d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.983605:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603000/0x3b8ec5973df57424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5741d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.983612:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603000, rc 0) 00000100:00100000:3.0:1789049986.983654:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.983660:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789049986.983786:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049986.983799:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.983807:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049986.983875:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.983902:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.983922:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.984099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600320 00000100:00100000:3.0:1789049986.984103:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600320 00000100:00100000:3.0:1789049986.984122:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789049986.984127:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.984246:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.984253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789049986.984354:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.984384:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049986.984423:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049986.984443:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.984905:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600448 00000100:00100000:3.0:1789049986.984921:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600448 00000100:00100000:3.0:1789049986.984964:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789049986.984972:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.985079:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049986.985085:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049986.985086:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789049986.985472:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10356:1875954714600576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.985530:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.985553:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049986.985606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600576 00000100:00100000:0.0:1789049986.985613:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600576 00000100:00100000:0.0:1789049986.985640:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789049986.985649:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:10356:x1875954714600576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049986.986113:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:10356:x1875954714600576:12345-0@lo:502:llog_process_th.0 Request processed in 464us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049986.986122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789049986.986217:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10356:1875954714600576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049986.986245:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049986.986253:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049986.986256:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789049986.986261:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789049986.986285:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10356:1875954714600704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.986321:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049986.986381:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049986.986412:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600704 00000100:00100000:2.0:1789049986.986417:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600704 00000100:00100000:2.0:1789049986.986454:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789049986.986461:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10356:x1875954714600704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049986.987516:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10356:x1875954714600704:12345-0@lo:502:llog_process_th.0 Request processed in 1050us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.987527:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789049986.987661:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10356:1875954714600704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049986.987689:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049986.987695:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049986.987703:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789049986.987709:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789049986.988233:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789049986.988258:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789049986.988269:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.988281:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049986.988289:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789049986.988292:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857ab380 from 1 10000000:01000000:0.0:1789049986.988302:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049986.988333:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.988342:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.988352:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049986.988373:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.988414:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.988450:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049986.988506:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600832 00000100:00100000:3.0:1789049986.988513:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600832 00000100:00100000:3.0:1789049986.988556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789049986.988565:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714600832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049986.988578:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049986.988591:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df57432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5742b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.988614:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df57432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5742b expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.988626:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df57432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5742b expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049986.988634:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602a00, rc 0) 00000100:00100000:3.0:1789049986.988679:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714600832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049986.988685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789049986.988832:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049986.988846:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049986.988864:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049986.988920:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049986.988972:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049986.988996:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049986.989189:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714600960 00000100:00100000:1.0:1789049986.989200:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714600960 00000100:00100000:1.0:1789049986.989226:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789049986.989233:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714600960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049986.989319:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714600960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (346us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049986.989327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789049986.989446:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714600960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789049986.989471:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789049986.989477:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049986.989485:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049987.177375:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714601088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049987.177463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049987.177517:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601088 00000100:00100000:2.0:1789049987.177527:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601088 00000100:00100000:2.0:1789049987.177605:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789049987.177611:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049987.177621:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714601088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049987.177657:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049987.177723:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714601088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049987.177731:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789049987.177832:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f4e00 x1875954714601088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049987.177864:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714601088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789049987.178207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049987.179573:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714601216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789049987.179636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.179907:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601216 00000100:00100000:3.0:1789049987.179916:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601216 00000100:00100000:3.0:1789049987.180087:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049987.180098:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714601216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789049987.180123:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049987.180169:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714601216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.180175:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789049987.180380:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049987.180921:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244aa00 x1875954714601216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049987.180964:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714601216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789049987.689574:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714601472:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.689650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049987.689651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714601728:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.689682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.689704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714601984:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.689704:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714602240:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.689727:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.689735:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714601600:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.689757:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049987.689768:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789049987.689771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714602112:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.689773:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714601344:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.689789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049987.689904:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601472 00000100:00100000:2.0:1789049987.689913:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601472 00000100:00100000:2.0:1789049987.689970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601728 00000100:00100000:2.0:1789049987.689974:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601728 00000100:00100000:2.0:1789049987.690002:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789049987.690011:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714601472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049987.690202:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049987.690211:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714602752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789049987.692445:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714601472:12345-0@lo:400:kworker.0 Request processed in 2426us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049987.692459:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789049987.692498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789049987.692511:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714601728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049987.692564:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714601728:12345-0@lo:400:kworker.0 Request processed in 59us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049987.692571:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049987.692716:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049987.692769:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602752 00000100:00100000:1.0:1789049987.692777:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602752 00000100:00100000:1.0:1789049987.692821:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049987.692828:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714602752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789049987.692885:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789049987.692923:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714602752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049987.692929:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789049987.692982:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832f4000 x1875954714602752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049987.693002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714602752:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789049987.693031:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049987.693054:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.697595:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602240 00000100:00100000:1.0:1789049987.697596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714601856:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.697609:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602240 00000100:00100000:1.0:1789049987.697663:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049987.697678:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714602368:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.697681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601600 00000100:00100000:3.0:1789049987.697686:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601600 00000100:00100000:3.0:1789049987.697708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602112 00000100:00100000:1.0:1789049987.697708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.697713:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602112 00000100:00100000:3.0:1789049987.697736:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601344 00000100:00100000:3.0:1789049987.697739:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601344 00000100:00100000:1.0:1789049987.697764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714601728:0@lo:400:kworker.0 00000100:00100000:1.0:1789049987.697797:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602368 00000100:00100000:1.0:1789049987.697800:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602368 00000100:00100000:0.0:1789049987.697821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601856 00000100:00100000:0.0:1789049987.697827:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601856 00000100:00100000:1.0:1789049987.697834:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049987.697956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789049987.697967:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714602240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049987.697970:0:6518:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789049987.697981:0:6518:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789049987.698005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049987.698030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714602496:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698037:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714602240:12345-0@lo:400:kworker.0 Request processed in 71us (8306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698045:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789049987.698062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049987.698069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714601984 00000100:00100000:0.0:1789049987.698074:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714601984 00000100:00100000:2.0:1789049987.698111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714601472:0@lo:400:kworker.0 00000100:00100000:2.0:1789049987.698122:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049987.698128:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049987.698153:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049987.698188:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789049987.698199:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714601600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698234:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714601600:12345-0@lo:400:kworker.0 Request processed in 37us (8476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698240:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789049987.698253:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789049987.698259:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714602112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698289:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714602112:12345-0@lo:400:kworker.0 Request processed in 30us (8498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698295:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789049987.698307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789049987.698312:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714601856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698341:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714601856:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789049987.698367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789049987.698373:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714601984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698403:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714601984:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789049987.698446:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602496 00000100:00100000:0.0:1789049987.698450:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602496 00000100:00100000:0.0:1789049987.698476:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049987.698483:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714602496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698515:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714602496:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049987.698521:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049987.698552:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714601600:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698565:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714602112:0@lo:400:kworker.0 00000100:00100000:0.0:1789049987.698597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714601856:0@lo:400:kworker.0 00010000:00080000:0.0:1789049987.698610:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982710380 x1875954714602240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049987.698621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714602240:0@lo:400:kworker.0 00010000:00080000:2.0:1789049987.698930:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982710000 x1875954714601984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049987.698966:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714601984:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.698969:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602624 00000100:00100000:3.0:1789049987.698975:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602624 00010000:00080000:2.0:1789049987.698983:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982712d80 x1875954714602496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049987.698991:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789049987.699007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049987.699012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714602496:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.699018:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714602624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049987.699037:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049987.699084:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714602624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.699094:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049987.699096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049987.699106:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714601344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049987.699145:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714601344:12345-0@lo:400:kworker.0 Request processed in 40us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049987.699151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049987.699182:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714601344:0@lo:400:kworker.0 00000100:00080000:3.0:1789049987.699190:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049987.699196:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049987.699199:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789049987.699229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832f7b80 x1875954714602624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049987.699245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049987.699912:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714602368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049987.700037:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714602368:12345-0@lo:400:kworker.0 Request processed in 2194us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049987.700044:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789049987.702164:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982713800 x1875954714602368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049987.702185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714602368:0@lo:400:kworker.0 00010000:00010000:2.0:1789049988.202364:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049988.551877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049988.551924:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049988.552071:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061184 00000100:00100000:3.0:1789049988.552082:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061184 00000100:00100000:3.0:1789049988.552144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00100000:3.0:1789049988.552155:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:2403:x1875954704061184:12345-192.168.203.42@tcp:400: 00000100:00100000:3.0:1789049988.552244:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:2403:x1875954704061184:12345-192.168.203.42@tcp:400: Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049988.552252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00100000:1.0:1789049988.552997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049988.553019:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049988.553069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061696 00000100:00100000:0.0:1789049988.553075:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061696 00000100:00100000:0.0:1789049988.553131:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789049988.553140:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061696:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789049988.553188:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061696:12345-192.168.203.42@tcp:400: Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.553205:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00080000:3.0:1789049988.554071:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049988.556561:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061440 00000100:00100000:2.0:1789049988.556578:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061440 00000100:00100000:2.0:1789049988.556737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789049988.556751:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061440:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789049988.556846:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061440:12345-192.168.203.42@tcp:400: Request processed in 89us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049988.556855:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789049988.558056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061312 00000100:00100000:1.0:1789049988.558067:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061312 00000100:00100000:0.0:1789049988.558725:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049988.558752:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061568 00000100:00100000:0.0:1789049988.558757:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061568 00000100:00100000:0.0:1789049988.559249:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:0.0:1789049988.559261:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061568:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789049988.559331:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704061568:12345-192.168.203.42@tcp:400: Request processed in 72us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.559339:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789049988.561458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789049988.561476:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704061312:12345-192.168.203.42@tcp:400: 00000100:00100000:1.0:1789049988.561555:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704061312:12345-192.168.203.42@tcp:400: Request processed in 86us (8535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049988.561563:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00080000:3.0:1789049988.562830:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049988.562855:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049988.562858:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789049989.225220:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049990.254223:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049990.257148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714602880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789049990.257251:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049990.257492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714602880 00000100:00100000:2.0:1789049990.257500:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714602880 00000100:00100000:2.0:1789049990.257569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049990.257579:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714602880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789049990.257614:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789049990.257745:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714602880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789049990.257781:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714602880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049990.257789:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049990.762231:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714603008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789049990.762312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049990.762577:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603008 00000100:00100000:1.0:1789049990.762586:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603008 00000100:00100000:1.0:1789049990.762675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049990.762686:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714603008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789049990.762738:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789049990.762795:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714603008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049990.762803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789049990.762887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714603008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789049991.113079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049991.113175:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061824 00000100:00100000:3.0:1789049991.113185:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061824 00000100:00100000:3.0:1789049991.113258:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:3.0:1789049991.113270:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:6177:x1875954704061824:12345-192.168.203.42@tcp:101: 00010000:00010000:3.0:1789049991.113288:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049991.113305:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df57439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966995 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049991.113337:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df57439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966995 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049991.113348:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df57439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966995 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049991.113357:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602c00, rc 0) 00000100:00100000:3.0:1789049991.113433:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704061824:12345-192.168.203.42@tcp:101: Request processed in 166us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049991.113439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:2.0:1789049991.121285:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049991.121457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061952 00000100:00100000:0.0:1789049991.121466:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061952 00000100:00100000:0.0:1789049991.121526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:0.0:1789049991.121537:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704061952:12345-192.168.203.42@tcp:501: 00000100:00100000:0.0:1789049991.121757:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704061952:12345-192.168.203.42@tcp:501: Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049991.121765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:2.0:1789049991.129583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049991.129976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062080 00000100:00100000:1.0:1789049991.129986:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062080 00000100:00100000:1.0:1789049991.130048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:1.0:1789049991.130059:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704062080:12345-192.168.203.42@tcp:503: 00000100:00100000:1.0:1789049991.130252:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704062080:12345-192.168.203.42@tcp:503: Request processed in 193us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049991.130259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:1.0:1789049991.134289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049991.134381:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062208 00000100:00100000:3.0:1789049991.134391:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062208 00000100:00100000:3.0:1789049991.134448:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:3.0:1789049991.134458:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6681:x1875954704062208:12345-192.168.203.42@tcp:502: 00000100:00100000:3.0:1789049991.134636:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6681:x1875954704062208:12345-192.168.203.42@tcp:502: Request processed in 179us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049991.134651:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:2.0:1789049991.138236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049991.138690:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062336 00000100:00100000:3.0:1789049991.138702:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062336 00000100:00100000:3.0:1789049991.138832:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:3.0:1789049991.138844:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6681:x1875954704062336:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049991.139056:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6681:x1875954704062336:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 214us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049991.139063:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:2.0:1789049991.145650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049991.145745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062464 00000100:00100000:1.0:1789049991.145756:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062464 00000100:00100000:1.0:1789049991.145813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 243 00000100:00100000:1.0:1789049991.145837:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704062464:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049991.145855:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049991.145874:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d6200/0x3b8ec5973df57440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad396699c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049991.145906:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d6200/0x3b8ec5973df57440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396699c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049991.145919:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d6200/0x3b8ec5973df57440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396699c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049991.145928:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6200, rc 0) 00000100:00100000:1.0:1789049991.146012:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704062464:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 190us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049991.146019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 243 00000100:00100000:1.0:1789049991.148443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049991.148524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062592 00000100:00100000:3.0:1789049991.148534:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062592 00000100:00100000:3.0:1789049991.148587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 244 00000100:00100000:3.0:1789049991.148598:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704062592:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049991.148716:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704062592:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 119us (281us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049991.148725:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 244 00010000:00010000:2.0:1789049991.274122:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049992.298718:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714603136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789049992.298884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049992.298993:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603136 00000100:00100000:2.0:1789049992.299001:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603136 00000100:00100000:2.0:1789049992.299065:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049992.299076:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714603136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789049992.299113:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049992.299162:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714603136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049992.299171:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789049992.299193:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049992.299225:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f4380 x1875954714603136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049992.299244:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714603136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789049992.299316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049992.299324:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714603264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049992.299353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.299393:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603264 00000100:00100000:3.0:1789049992.299399:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603264 00000100:00100000:3.0:1789049992.299432:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049992.299439:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714603264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049992.299451:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049992.299482:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714603264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.299488:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789049992.299514:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049992.301771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f4380 x1875954714603264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049992.301799:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714603264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049992.303868:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049992.811528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714603520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789049992.811528:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714603392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049992.811776:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714603648:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.815554:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.815617:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603520 00000100:00100000:3.0:1789049992.815626:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603520 00000100:00100000:3.0:1789049992.815683:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049992.815693:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714603520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789049992.815726:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789049992.815776:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714603520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.815783:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049992.815836:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714603776:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.815871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.815921:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714604288:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.815956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.815987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.816007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.816034:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789049992.816040:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714603904:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.816061:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.816077:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714604416:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.816098:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.816114:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714604928:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.816133:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789049992.816152:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789049992.816166:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603776 00000100:00100000:3.0:1789049992.816170:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603776 00000100:00100000:3.0:1789049992.816191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604288 00000100:00100000:3.0:1789049992.816201:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604288 00000100:00100000:3.0:1789049992.816222:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604800 00000100:00100000:3.0:1789049992.816224:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604800 00000100:00100000:3.0:1789049992.816236:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604416 00000100:00100000:3.0:1789049992.816238:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604416 00000100:00100000:3.0:1789049992.816250:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604928 00000100:00100000:3.0:1789049992.816252:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604928 00000100:00100000:3.0:1789049992.816265:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049992.816444:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.816489:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714604032:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.816518:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.816532:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714604544:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.816554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.816576:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714605056:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.816608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.816639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604032 00000100:00100000:1.0:1789049992.816643:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604032 00000100:00100000:3.0:1789049992.818614:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714603776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.818619:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049992.818634:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714604288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.821104:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714603776:12345-0@lo:400:kworker.0 Request processed in 2500us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.821119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789049992.821157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789049992.821168:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.821212:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714604288:12345-0@lo:400:kworker.0 Request processed in 2578us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.821222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049992.821250:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789049992.821259:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714604800:12345-0@lo:400:kworker.0 Request processed in 94us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.821265:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714604416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.821307:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714604416:12345-0@lo:400:kworker.0 Request processed in 50us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.821313:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789049992.821329:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789049992.821336:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714604928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.821526:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789049992.821541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789049992.821548:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714604032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049992.821891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603904 00000100:00100000:0.0:1789049992.821900:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603904 00000100:00100000:0.0:1789049992.821967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789049992.821975:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714603904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.822209:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714604032:12345-0@lo:400:kworker.0 Request processed in 660us (5688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.822226:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789049992.822587:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789049992.822592:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789049992.822628:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982449500 x1875954714604416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.822644:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714604416:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.822672:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714603776:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.822684:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714604288:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.822695:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.822741:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714604032:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.822801:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982710e00 x1875954714603520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.822831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714603520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789049992.823196:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604544 00000100:00100000:3.0:1789049992.823204:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604544 00000100:00100000:3.0:1789049992.823497:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605056 00000100:00100000:3.0:1789049992.823502:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605056 00000100:00100000:3.0:1789049992.823527:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049992.823535:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.823600:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714604544:12345-0@lo:400:kworker.0 Request processed in 65us (7044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.823606:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049992.823623:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049992.823629:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714605056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.823659:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714605056:12345-0@lo:400:kworker.0 Request processed in 30us (7050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.823665:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789049992.823701:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244ad80 x1875954714604544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.823712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714604544:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.823730:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745180 x1875954714605056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.823737:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714605056:0@lo:400:kworker.0 00000100:00100000:0.0:1789049992.824928:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714603904:12345-0@lo:400:kworker.0 Request processed in 2946us (8857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.824929:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714604928:12345-0@lo:400:kworker.0 Request processed in 3585us (8786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.824960:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049992.825283:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714603904:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.825300:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244b480 x1875954714604928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.825310:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714604928:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.825432:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603392 00000100:00100000:1.0:1789049992.825439:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603392 00000100:00100000:1.0:1789049992.825569:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789049992.825579:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714603392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049992.825601:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789049992.825651:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714603392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (9207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.825657:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789049992.825701:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832f5500 x1875954714603392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049992.825717:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714603392:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789049992.825893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049992.829301:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.829407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714604160:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.829463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.829487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714604672:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.829515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.829534:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714605184:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.829558:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049992.830845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789049992.830878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604160 00000100:00100000:0.0:1789049992.830886:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604160 00000100:00100000:0.0:1789049992.830918:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789049992.830928:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714604160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049992.832487:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714604160:12345-0@lo:400:kworker.0 Request processed in 1556us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049992.832499:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789049992.832572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714604160:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.833903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714603648 00000100:00100000:3.0:1789049992.833918:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714603648 00000100:00100000:3.0:1789049992.833985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789049992.833995:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714603648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.834323:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714603648:12345-0@lo:400:kworker.0 Request processed in 329us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.834331:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789049992.834381:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714604672 00000100:00100000:3.0:1789049992.834385:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714604672 00000100:00100000:3.0:1789049992.834411:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605184 00000100:00100000:3.0:1789049992.834414:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605184 00000100:00100000:3.0:1789049992.834435:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049992.834442:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.834482:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714604672:12345-0@lo:400:kworker.0 Request processed in 41us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.834488:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049992.834501:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049992.834520:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714605184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.834553:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714605184:12345-0@lo:400:kworker.0 Request processed in 36us (4996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.834558:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049992.834605:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714603648:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.834622:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244b800 x1875954714604672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.834634:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714604672:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.834647:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982744e00 x1875954714605184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.834656:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714605184:0@lo:400:kworker.0 00000020:00000080:0.0:1789049992.962148:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec7b6d020 20000000:00000080:0.0:1789049992.962167:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baaae6af400 uarg=0000000000000000 20000000:01000000:0.0:1789049992.962215:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789049992.962221:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789049992.962226:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789049992.966387:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789049992.966557:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789049992.973781:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789049992.979200:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789049992.980410:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789049992.980442:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789049992.980466:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980486:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980495:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980502:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980521:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980532:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980539:0:10395:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980580:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980597:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 9 pid: 6510 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.980612:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605312:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789049992.980729:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980737:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 23 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.980747:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605440:0@lo:104: 00000100:00100000:0.0:1789049992.980801:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049992.980872:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.980880:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.980895:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605568:0@lo:104: 00000100:00100000:0.0:1789049992.980920:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049992.980976:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789049992.980989:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605440 00000100:00100000:0.0:1789049992.980996:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605440 00000100:00100000:0.0:1789049992.981038:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605568 00000100:00100000:0.0:1789049992.981041:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605568 00000100:00100000:0.0:1789049992.981056:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049992.981064:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605440:12345-0@lo:104: 00000100:00100000:1.0:1789049992.981125:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789049992.981136:0:9521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605568:12345-0@lo:104: 00010000:00010000:1.0:1789049992.981146:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981198:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049992.981204:0:9521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605568:12345-0@lo:104: Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.981210:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789049992.981238:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049992.981243:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981253:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049992.981256:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981271:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049992.981278:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049992.981283:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049992.981308:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981314:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049992.981335:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981342:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5713e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57145 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981357:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049992.981358:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049992.981360:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049992.981412:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981421:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049992.981431:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605824:0@lo:104: 00000100:00100000:1.0:1789049992.981455:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049992.981475:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605824 00000100:00100000:1.0:1789049992.981485:0:9521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605824 00000100:00100000:1.0:1789049992.981509:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049992.981515:0:9521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605824:12345-0@lo:104: 00010000:00010000:1.0:1789049992.981523:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981553:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049992.981557:0:9521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605824:12345-0@lo:104: Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.981562:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789049992.981590:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.981599:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 23 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049992.981607:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605952:0@lo:104: 00010000:00010000:0.0:1789049992.981614:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049992.981631:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.982742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714605696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049992.983043:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605952 00000100:00100000:1.0:1789049992.983050:0:9521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605952 00000100:00100000:1.0:1789049992.983090:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049992.983098:0:9521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605952:12345-0@lo:104: 00010000:00010000:1.0:1789049992.983110:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983162:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789049992.983168:0:9521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8839590-fd25-4606-bad2-917c49937107+4:10395:x1875954714605952:12345-0@lo:104: Request processed in 72us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.983174:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049992.983220:0:10395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049992.983246:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605568:0@lo:104: 00000100:00100000:1.0:1789049992.983261:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605824:0@lo:104: 00000100:00100000:1.0:1789049992.983270:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605952:0@lo:104: 00000100:00100000:1.0:1789049992.983309:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605440:0@lo:104: 00010000:00010000:0.0:1789049992.983309:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789049992.983321:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:10395:x1875954714605440:12345-0@lo:104: Request processed in 2256us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049992.983329:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1789049992.983359:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789049992.983367:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983376:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049992.983380:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983387:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049992.983389:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983394:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049992.983399:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983409:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602400 already unused, calling callback (ffffffffc1287c20) 10000000:01000000:1.0:1789049992.983412:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1789049992.983415:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983424:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049992.983431:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983437:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983457:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789049992.983458:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049992.983471:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983482:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df570ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983482:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983498:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049992.983519:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049992.983519:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983525:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983531:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602400/0x3b8ec5973df570dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df570e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983536:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789049992.983542:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983551:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.983551:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049992.983555:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049992.983558:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789049992.983564:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.983571:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714606208:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789049992.983572:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049992.983593:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983601:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049992.983608:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.983619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049992.983620:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603200/0x3b8ec5973df57264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5726b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983638:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049992.983640:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049992.983642:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049992.983662:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606208 00000100:00100000:1.0:1789049992.983674:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606208 00010000:00010000:1.0:1789049992.983696:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 24 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049992.983720:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049992.983727:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714606208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049992.983738:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049992.983743:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 24 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983752:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 24 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983765:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043000/0x3b8ec5973df570e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df570dc expref: 24 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.983792:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049992.983830:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+23:3644:x1875954714606208:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049992.983838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1789049992.984062:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049992.984198:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.984237:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049992.984244:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714606080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049992.984265:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.984296:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714606336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049992.984319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.984345:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714605696 00000100:00100000:3.0:1789049992.984350:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714605696 00010000:00010000:3.0:1789049992.984368:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049992.984387:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606080 00000100:00100000:3.0:1789049992.984391:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606080 00010000:00010000:3.0:1789049992.984412:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 24 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049992.984424:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606336 00000100:00100000:3.0:1789049992.984426:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606336 00010000:00010000:3.0:1789049992.984437:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 25 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049992.984448:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789049992.984454:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+25:3646:x1875954714605696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049992.984462:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049992.984466:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 25 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984474:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 25 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984486:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602600/0x3b8ec5973df57145 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5713e expref: 25 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984497:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049992.984524:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714605696:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.984531:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789049992.984549:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789049992.984555:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714606080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049992.984563:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049992.984567:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984585:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984595:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df570f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df570ea expref: 23 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.984604:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049992.984626:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714606080:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.984632:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789049992.984645:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049992.984651:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+21:3645:x1875954714606336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049992.985382:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049992.985392:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 21 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.985403:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 21 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.985415:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2176200/0x3b8ec5973df5726b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57264 expref: 21 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049992.985427:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049992.985464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714606208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049992.986743:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+20:3645:x1875954714606336:12345-0@lo:103:ldlm_bl.0 Request processed in 2086us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.986757:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049992.986857:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714606080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049992.986866:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714605696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049992.987438:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714606336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049992.988549:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875954714605312:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789049992.988590:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049992.998993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049992.999131:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062720 00000100:00100000:0.0:1789049992.999142:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062720 00010000:00010000:0.0:1789049992.999182:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049992.999225:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:0.0:1789049992.999236:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2403:x1875954704062720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049992.999250:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049992.999268:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999281:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999300:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602200/0x3b8ec5973df5733d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad396695d expref: 10 pid: 6510 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999319:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999329:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999346:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999353:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999361:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999369:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999376:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789049992.999380:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999387:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999417:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049992.999429:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049992.999494:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:2403:x1875954704062720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 260us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049992.999501:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00010000:00010000:1.0:1789049992.999757:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.999767:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049992.999785:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae779400/0x3b8ec5973df57447 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049993.321358:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049993.673261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789049993.673381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062848 00000100:00100000:1.0:1789049993.673392:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062848 00000100:00100000:1.0:1789049993.673443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 246 00000100:00100000:1.0:1789049993.673454:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:2406:x1875954704062848:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789049993.673546:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:2406:x1875954704062848:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 93us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049993.673554:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 246 00000100:00100000:2.0:1789049993.674120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049993.674190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063104 00000100:00100000:0.0:1789049993.674196:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063104 00000100:00100000:0.0:1789049993.674258:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:0.0:1789049993.674267:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704063104:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789049993.674309:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704063104:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049993.674316:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00080000:3.0:1789049993.674754:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789049993.674957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049993.675169:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049993.675211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049993.675244:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063360 00000100:00100000:2.0:1789049993.675249:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063360 00000100:00100000:2.0:1789049993.675284:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063232 00000100:00100000:2.0:1789049993.675286:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063232 00000100:00100000:2.0:1789049993.675303:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:2.0:1789049993.675311:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704063360:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789049993.675348:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704063360:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049993.675354:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:2.0:1789049993.675366:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:2.0:1789049993.675372:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704063232:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789049993.675390:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704063232:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 18us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049993.675396:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00080000:2.0:1789049993.675416:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049993.675419:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049993.675534:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062976 00000100:00100000:1.0:1789049993.675540:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062976 00000100:00100000:1.0:1789049993.675586:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:1.0:1789049993.675602:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704062976:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789049993.675633:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704062976:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049993.675639:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00080000:2.0:1789049993.676036:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1789049994.222374:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049994.222382:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab4394800 from 4 10000000:01000000:1.0:1789049994.222387:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049994.222437:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049994.222450:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049994.222461:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049994.222498:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049994.222576:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049994.222632:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.222644:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606464 00000100:00100000:2.0:1789049994.222653:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606464 00000100:00100000:2.0:1789049994.222724:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789049994.222735:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714606464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049994.222753:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049994.222768:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5744e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.222808:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.222820:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.222830:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5e00, rc 0) 00000100:00100000:2.0:1789049994.222873:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714606464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.222880:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789049994.223141:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049994.223157:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049994.223166:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049994.223230:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049994.223259:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049994.223292:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.223349:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606592 00000100:00100000:2.0:1789049994.223354:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606592 00000100:00100000:2.0:1789049994.223385:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789049994.223392:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714606592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.223503:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714606592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.223510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789049994.223585:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049994.223628:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049994.223672:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049994.223690:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049994.223846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606720 00000100:00100000:3.0:1789049994.223852:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606720 00000100:00100000:3.0:1789049994.223881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789049994.223986:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714606720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049994.224260:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714606720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049994.224267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789049994.224362:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714606720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.230401:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10445:1875954714606848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.230503:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.230595:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049994.231168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606848 00000100:00100000:1.0:1789049994.231176:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606848 00000100:00100000:1.0:1789049994.231282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789049994.231293:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10445:x1875954714606848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049994.231463:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:10445:x1875954714606848:12345-0@lo:502:llog_process_th.0 Request processed in 171us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049994.231471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789049994.231553:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10445:1875954714606848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049994.231588:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049994.231598:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049994.231600:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789049994.231624:0:10445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baab4394800 00000020:00000080:0.0:1789049994.231628:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789049994.231732:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10445:1875954714606976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049994.231786:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049994.232207:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa91a689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.232501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714606976 00000100:00100000:2.0:1789049994.232508:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714606976 00000100:00100000:3.0:1789049994.237311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789049994.237324:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:10445:x1875954714606976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049994.239868:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:10445:x1875954714606976:12345-0@lo:502:llog_process_th.0 Request processed in 2539us (8073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049994.239884:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789049994.241241:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10445:1875954714606976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049994.241287:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049994.241302:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049994.241304:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789049994.241309:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789049994.241845:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789049994.241873:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049994.241885:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.241905:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049994.241916:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049994.241919:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac621000 from 4 10000000:01000000:2.0:1789049994.241922:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049994.242284:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.242294:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.242305:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.242328:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.242396:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.242441:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049994.242491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607104 00000100:00100000:0.0:1789049994.242500:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607104 00000100:00100000:0.0:1789049994.242547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789049994.242558:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714607104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049994.242573:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049994.242586:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5745c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.242624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.242637:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.242646:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778600, rc 0) 00000100:00100000:1.0:1789049994.244516:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1954us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049994.244528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789049994.245834:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049994.245863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.245876:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.245996:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.246118:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.246176:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.248094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607232 00000100:00100000:2.0:1789049994.248109:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607232 00000100:00100000:2.0:1789049994.248170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789049994.248181:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.248353:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.248361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789049994.248415:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.248464:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.248515:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.248545:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.248569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607360 00000100:00100000:2.0:1789049994.248574:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607360 00000100:00100000:2.0:1789049994.248601:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789049994.248608:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.248713:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.248721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789049994.248773:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.249008:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10448:1875954714607488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.249043:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.249063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607488 00000100:00100000:2.0:1789049994.249066:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607488 00000100:00100000:2.0:1789049994.249088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789049994.249095:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:10448:x1875954714607488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.249161:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:10448:x1875954714607488:12345-0@lo:502:llog_process_th.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.249167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789049994.249191:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.249201:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10448:1875954714607488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049994.249219:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049994.249227:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049994.249230:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789049994.249238:0:10448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baaac621000 00000020:00000080:2.0:1789049994.249240:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789049994.249300:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10448:1875954714607616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.249329:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.249344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607616 00000100:00100000:2.0:1789049994.249348:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607616 00000100:00100000:2.0:1789049994.249364:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789049994.249369:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:10448:x1875954714607616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.249421:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:10448:x1875954714607616:12345-0@lo:502:llog_process_th.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.249427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789049994.249451:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.249461:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10448:1875954714607616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049994.249477:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049994.249482:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049994.249483:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789049994.249487:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789049994.249536:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789049994.249561:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049994.249571:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249583:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049994.249594:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049994.249597:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab0ea0000 from 4 10000000:01000000:2.0:1789049994.249600:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049994.249623:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249631:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249640:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.249652:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.249673:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.249684:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.249694:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607744 00000100:00100000:2.0:1789049994.249697:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607744 00000100:00100000:2.0:1789049994.249713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789049994.249718:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714607744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049994.249726:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049994.249736:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5746a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249767:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249777:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249786:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5200, rc 0) 00000100:00100000:2.0:1789049994.249823:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714607744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.249829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789049994.249853:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049994.249863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.249871:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.250230:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.250254:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.250267:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.250277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714607872 00000100:00100000:2.0:1789049994.250280:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714607872 00000100:00100000:2.0:1789049994.250300:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789049994.250306:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714607872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.250383:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714607872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.250398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789049994.250426:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714607872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.250448:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.250478:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.250489:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.250499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608000 00000100:00100000:2.0:1789049994.250501:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608000 00000100:00100000:2.0:1789049994.250518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789049994.250523:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714608000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.250579:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714608000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.250585:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789049994.250616:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049994.255251:0:10449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10449:1875954714608128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049994.255337:0:10449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049994.255372:0:10449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9824f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.255605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608128 00000100:00100000:2.0:1789049994.255613:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608128 00000100:00100000:2.0:1789049994.255667:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789049994.255677:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:10449:x1875954714608128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.255888:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:10449:x1875954714608128:12345-0@lo:502:llog_process_th.0 Request processed in 212us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.255895:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789049994.256164:0:10449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10449:1875954714608128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049994.256195:0:10449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049994.256206:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049994.256209:0:10449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789049994.256216:0:10449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baab0ea0000 00000020:00000080:3.0:1789049994.256218:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049994.256294:0:10449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10449:1875954714608256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049994.256332:0:10449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049994.256358:0:10449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9824f3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049994.257596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608256 00000100:00100000:0.0:1789049994.257606:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608256 00000100:00100000:0.0:1789049994.257652:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789049994.257660:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10449:x1875954714608256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049994.257819:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:10449:x1875954714608256:12345-0@lo:502:llog_process_th.0 Request processed in 159us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049994.257827:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789049994.258439:0:10449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10449:1875954714608256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049994.258473:0:10449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049994.258480:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049994.258487:0:10449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789049994.258491:0:10449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789049994.258585:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789049994.258607:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049994.258619:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.258640:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049994.258650:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049994.258653:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac606800 from 4 10000000:01000000:2.0:1789049994.258655:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049994.258685:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.258693:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.258703:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.258726:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.259298:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.259371:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049994.259409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608384 00000100:00100000:0.0:1789049994.259415:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608384 00000100:00100000:0.0:1789049994.259488:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789049994.259497:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714608384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049994.259518:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049994.259530:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.259552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.259563:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.259571:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778000, rc 0) 00000100:00100000:0.0:1789049994.259613:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714608384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049994.259620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789049994.259675:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049994.259688:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.259697:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049994.259751:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.259790:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.259819:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.259830:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608512 00000100:00100000:2.0:1789049994.259834:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608512 00000100:00100000:2.0:1789049994.259855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789049994.259860:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714608512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.259971:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714608512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.259978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789049994.260008:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.260035:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.260071:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.260083:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.260094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608640 00000100:00100000:2.0:1789049994.260097:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608640 00000100:00100000:2.0:1789049994.260115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789049994.260121:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714608640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.260212:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714608640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.260218:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789049994.260254:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714608640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049994.260410:0:10452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10452:1875954714608768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.260442:0:10452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.260458:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608768 00000100:00100000:2.0:1789049994.260462:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608768 00000100:00100000:2.0:1789049994.260482:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789049994.260488:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:10452:x1875954714608768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.260555:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:10452:x1875954714608768:12345-0@lo:502:llog_process_th.0 Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.260563:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789049994.260597:0:10452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.260609:0:10452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10452:1875954714608768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049994.260629:0:10452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049994.260638:0:10452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049994.260640:0:10452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789049994.260649:0:10452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baaac606800 00000020:00000080:2.0:1789049994.260652:0:10452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789049994.261011:0:10452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10452:1875954714608896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.261048:0:10452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049994.261070:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714608896 00000100:00100000:2.0:1789049994.261074:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714608896 00000100:00100000:2.0:1789049994.261096:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789049994.261103:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:10452:x1875954714608896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049994.261163:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:10452:x1875954714608896:12345-0@lo:502:llog_process_th.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049994.261170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789049994.261199:0:10452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049994.261211:0:10452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:10452:1875954714608896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049994.261229:0:10452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049994.261234:0:10452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049994.261235:0:10452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789049994.261245:0:10452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789049994.261296:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789049994.261320:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049994.261327:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049994.261336:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049994.353218:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049995.017217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049995.017558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063488 00000100:00100000:2.0:1789049995.017567:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063488 00000100:00100000:2.0:1789049995.017631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 267 00000100:00100000:2.0:1789049995.017642:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:6177:x1875954704063488:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049995.017662:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049995.017679:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad39669a3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049995.017706:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049995.017718:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049995.017727:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a5a00, rc 0) 00000100:00100000:2.0:1789049995.017787:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704063488:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 147us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049995.017805:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 267 00000100:00100000:3.0:1789049995.021056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789049995.023251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063616 00000100:00100000:0.0:1789049995.023264:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063616 00000100:00100000:0.0:1789049995.023333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 268 00000100:00100000:0.0:1789049995.023344:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704063616:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049995.023507:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704063616:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 163us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049995.023516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 268 00000100:00100000:0.0:1789049995.026376:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049995.026482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063744 00000100:00100000:2.0:1789049995.026492:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063744 00000100:00100000:2.0:1789049995.026551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 269 00000100:00100000:2.0:1789049995.026560:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704063744:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049995.027217:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6177:x1875954704063744:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 655us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049995.027226:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 269 00000100:00100000:2.0:1789049995.040182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789049995.040411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063872 00000100:00100000:3.0:1789049995.040422:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063872 00000100:00100000:3.0:1789049995.040491:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 270 00000100:00100000:3.0:1789049995.040503:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6744:x1875954704063872:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049995.040724:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6744:x1875954704063872:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 223us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049995.040733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 270 00000100:00100000:0.0:1789049995.046374:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049995.046427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064000 00000100:00100000:2.0:1789049995.046438:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064000 00000100:00100000:2.0:1789049995.046502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 271 00000100:00100000:2.0:1789049995.046513:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6744:x1875954704064000:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049995.046670:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:6744:x1875954704064000:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 158us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049995.046678:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 271 00010000:00010000:2.0:1789049995.369463:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049995.369512:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049995.369538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714609024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789049995.369617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049995.369645:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609024 00000100:00100000:0.0:1789049995.369655:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609024 00000100:00100000:0.0:1789049995.369716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049995.369740:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714609024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789049995.369781:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789049995.369850:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714609024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049995.369857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049995.370025:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714609024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789049995.890605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049995.892619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714609152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789049995.894457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049995.896169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609152 00000100:00100000:2.0:1789049995.896184:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609152 00000100:00100000:2.0:1789049995.899065:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789049995.899089:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714609152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789049995.899136:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789049995.905462:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714609152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6372us (10999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049995.905490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049995.905664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714609152:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789049996.394406:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049997.421452:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049997.421564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714609280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789049997.424004:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714609408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049997.429772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.429927:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.429983:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609280 00000100:00100000:2.0:1789049997.429993:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609280 00000100:00100000:2.0:1789049997.430050:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609408 00000100:00100000:2.0:1789049997.430054:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609408 00000100:00100000:2.0:1789049997.430075:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049997.430085:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714609280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789049997.430120:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049997.430398:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049997.430410:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714609408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049997.430423:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789049997.432706:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049997.440409:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714609408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9992us (10472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049997.440423:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789049997.440507:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368f100 x1875954714609408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049997.440531:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714609408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049997.443402:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714609280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13311us (13630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.443425:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789049997.443645:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f5880 x1875954714609280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.443668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714609280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789049997.929309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714609664:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.929380:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.929511:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714609792:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.929620:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714609536:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.929750:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.929820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714610304:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.929845:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.929864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714610816:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.929883:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.929918:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789049997.929925:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714609920:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.931701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.931753:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714610432:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.931804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.931852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714610944:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.931876:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.931949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609664 00000100:00100000:0.0:1789049997.932186:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609664 00000100:00100000:0.0:1789049997.932234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610304 00000100:00100000:0.0:1789049997.932238:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610304 00000100:00100000:0.0:1789049997.932266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610816 00000100:00100000:0.0:1789049997.932269:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610816 00000100:00100000:0.0:1789049997.932281:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609920 00000100:00100000:0.0:1789049997.932283:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609920 00000100:00100000:0.0:1789049997.932295:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789049997.932303:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714609664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.932364:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714609664:12345-0@lo:400:kworker.0 Request processed in 61us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.932372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789049997.932454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789049997.932462:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714610304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.932501:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714610304:12345-0@lo:400:kworker.0 Request processed in 40us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.932507:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789049997.932521:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789049997.932527:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714610816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.932553:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714610816:12345-0@lo:400:kworker.0 Request processed in 27us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.932574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789049997.932586:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049997.932593:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714609920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.932626:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714609920:12345-0@lo:400:kworker.0 Request processed in 34us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.932632:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049997.932654:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609792 00000100:00100000:0.0:1789049997.932657:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609792 00000100:00100000:0.0:1789049997.932692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789049997.932699:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714609792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.932731:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714609792:12345-0@lo:400:kworker.0 Request processed in 34us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.932737:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789049997.932769:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610432 00000100:00100000:0.0:1789049997.932785:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610432 00000100:00100000:0.0:1789049997.932897:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610944 00000100:00100000:0.0:1789049997.933044:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610944 00000100:00100000:0.0:1789049997.933072:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049997.933080:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714610432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.933117:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714610432:12345-0@lo:400:kworker.0 Request processed in 39us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.933122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049997.933135:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049997.933141:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714610944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.933169:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714610944:12345-0@lo:400:kworker.0 Request processed in 28us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.933185:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789049997.933202:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049997.933207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789049997.933243:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714609920:0@lo:400:kworker.0 00010000:00080000:0.0:1789049997.933257:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794a80 x1875954714610432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.933268:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714610432:0@lo:400:kworker.0 00010000:00080000:0.0:1789049997.933278:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae709500 x1875954714610944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.933286:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714610944:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.933296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714609792:0@lo:400:kworker.0 00010000:00080000:0.0:1789049997.933305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae796300 x1875954714610304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.933313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714610304:0@lo:400:kworker.0 00010000:00080000:0.0:1789049997.933321:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae795f80 x1875954714610816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.933329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714610816:0@lo:400:kworker.0 00000100:00100000:0.0:1789049997.937515:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049997.937543:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714611328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049997.937618:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049997.938373:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611328 00000100:00100000:0.0:1789049997.938383:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611328 00000100:00100000:0.0:1789049997.938447:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049997.938462:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714611328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049997.938494:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789049997.938547:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714611328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049997.938553:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789049997.938571:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789049997.938597:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c000 x1875954714611328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.938616:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714611328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049997.939002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714609664:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714610176:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.939061:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714610688:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939079:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.939100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610176 00000100:00100000:2.0:1789049997.939104:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610176 00000100:00100000:2.0:1789049997.939134:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610688 00000100:00100000:2.0:1789049997.939136:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610688 00000100:00100000:2.0:1789049997.939154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049997.939160:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714610176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939191:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714610176:12345-0@lo:400:kworker.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.939197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049997.939208:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789049997.939213:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714610688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939245:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714610688:12345-0@lo:400:kworker.0 Request processed in 32us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.939251:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789049997.939269:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049997.939282:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714610688:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.939301:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714611200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789049997.939322:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.939340:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611200 00000100:00100000:2.0:1789049997.939343:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611200 00000100:00100000:2.0:1789049997.939360:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049997.939366:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714611200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789049997.939376:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789049997.939466:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714611200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.939472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789049997.939496:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983688000 x1875954714611200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049997.939510:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714611200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789049997.939518:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714610176:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.940554:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.940597:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714610048:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.940631:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.941172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714609536 00000100:00100000:2.0:1789049997.941181:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714609536 00000100:00100000:2.0:1789049997.941231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789049997.941240:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714609536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.941294:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714609536:12345-0@lo:400:kworker.0 Request processed in 56us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.941309:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789049997.941658:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714610560:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.941688:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.941715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714611072:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.941737:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.941769:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714609536:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.941878:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610560 00000100:00100000:2.0:1789049997.941883:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610560 00000100:00100000:2.0:1789049997.941925:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611072 00000100:00100000:2.0:1789049997.941929:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611072 00000100:00100000:2.0:1789049997.941967:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049997.941974:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714610560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.942018:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714610560:12345-0@lo:400:kworker.0 Request processed in 45us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.942025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049997.942037:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789049997.942043:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714611072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.942069:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714611072:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.942074:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789049997.942104:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae796a00 x1875954714610560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049997.942115:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714610560:0@lo:400:kworker.0 00010000:00080000:2.0:1789049997.942122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c0000 x1875954714611072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049997.942129:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714611072:0@lo:400:kworker.0 00000100:00100000:1.0:1789049997.942413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714610048 00000100:00100000:1.0:1789049997.942419:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714610048 00000100:00100000:1.0:1789049997.942459:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789049997.942467:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714610048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049997.942520:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714610048:12345-0@lo:400:kworker.0 Request processed in 55us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049997.942527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049997.942659:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714610048:0@lo:400:kworker.0 00010000:00010000:2.0:1789049998.442320:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049998.794499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049998.794548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049998.794584:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049998.794632:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049998.794660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789049998.794689:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064640 00000100:00100000:2.0:1789049998.794698:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064640 00000100:00100000:2.0:1789049998.794759:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064512 00000100:00100000:2.0:1789049998.794763:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064512 00000100:00100000:2.0:1789049998.794802:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789049998.794812:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064640:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789049998.794898:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064640:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049998.794906:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789049998.794923:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789049998.794931:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064512:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789049998.794984:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064512:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049998.794990:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789049998.795012:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064384 00000100:00100000:2.0:1789049998.795015:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064384 00000100:00100000:2.0:1789049998.795080:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064256 00000100:00100000:2.0:1789049998.795084:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064256 00000100:00100000:2.0:1789049998.795107:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:2.0:1789049998.795114:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064384:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789049998.795240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:0.0:1789049998.795250:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704064256:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789049998.795280:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704064256:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 32us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049998.795286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00080000:0.0:1789049998.795399:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049998.795403:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789049998.795405:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049998.795407:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049998.795927:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704064384:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 810us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049998.795958:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:3.0:1789049998.796305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064128 00000100:00100000:3.0:1789049998.796314:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064128 00000100:00100000:3.0:1789049998.796355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 273 00000100:00100000:3.0:1789049998.796363:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704064128:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789049998.796400:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704064128:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049998.796406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 273 00000001:02000400:2.0:1789049999.141321:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789049999.466311:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050000.490114:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714611456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050000.490195:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050000.490392:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611456 00000100:00100000:3.0:1789050000.490402:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611456 00000100:00100000:3.0:1789050000.490456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789050000.490466:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714611456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050000.490502:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050000.490549:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714611456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.490555:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789050000.490746:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714611456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789050000.490836:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050001.004711:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714611584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050001.004798:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050001.004912:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611584 00000100:00100000:3.0:1789050001.004920:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611584 00000100:00100000:3.0:1789050001.004991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789050001.005002:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714611584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050001.005039:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050001.005092:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714611584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050001.005099:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789050001.005150:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714611584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050001.517401:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050002.537072:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050002.537376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714611712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050002.537445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050002.537565:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611712 00000100:00100000:1.0:1789050002.537573:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611712 00000100:00100000:1.0:1789050002.537635:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050002.537645:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714611712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050002.537690:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050002.537733:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714611712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050002.537752:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789050002.537811:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789050002.537839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368fb80 x1875954714611712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050002.537856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714611712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050002.538227:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714611840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050002.538256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050002.538288:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611840 00000100:00100000:3.0:1789050002.538292:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611840 00000100:00100000:3.0:1789050002.538390:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789050002.538398:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714611840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050002.538410:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050002.538438:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714611840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050002.538443:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789050002.538460:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789050002.538474:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982711880 x1875954714611840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050002.538486:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714611840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050003.051248:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714611968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050003.051324:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051394:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714612480:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051421:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714612992:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051495:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714613504:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051540:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789050003.051547:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714612352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051589:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714612864:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051610:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051625:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714613376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051645:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051680:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714612096:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.051709:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.051734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714612608:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.054722:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714611968 00000100:00100000:0.0:1789050003.054746:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714611968 00000100:00100000:0.0:1789050003.054832:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050003.054844:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714611968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050003.054886:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050003.054987:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714611968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.054995:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050003.055021:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612480 00000100:00100000:0.0:1789050003.055025:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612480 00000100:00100000:0.0:1789050003.055053:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612864 00000100:00100000:0.0:1789050003.055057:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612864 00000100:00100000:0.0:1789050003.055070:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613376 00000100:00100000:0.0:1789050003.055073:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613376 00000100:00100000:0.0:1789050003.055088:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789050003.055094:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714612480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.055129:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714612480:12345-0@lo:400:kworker.0 Request processed in 35us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.055136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789050003.055148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050003.055154:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714612864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.055182:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714612864:12345-0@lo:400:kworker.0 Request processed in 29us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.055189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050003.055214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050003.055221:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714613376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.055250:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714613376:12345-0@lo:400:kworker.0 Request processed in 30us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.055256:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050003.055283:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612992 00000100:00100000:0.0:1789050003.055288:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612992 00000100:00100000:0.0:1789050003.055311:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613504 00000100:00100000:0.0:1789050003.055314:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613504 00000100:00100000:0.0:1789050003.055330:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050003.055336:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714612992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.055368:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714612992:12345-0@lo:400:kworker.0 Request processed in 32us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.055374:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050003.055384:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789050003.055389:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714613504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.055429:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714613504:12345-0@lo:400:kworker.0 Request processed in 41us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.055434:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789050003.055490:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983689180 x1875954714612864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.055505:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714612864:0@lo:400:kworker.0 00010000:00080000:0.0:1789050003.055519:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae795180 x1875954714613376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.055527:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714613376:0@lo:400:kworker.0 00010000:00080000:0.0:1789050003.055537:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd5500 x1875954714611968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.055548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714611968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050003.055558:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714612480:0@lo:400:kworker.0 00010000:00080000:0.0:1789050003.055578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983689f80 x1875954714612992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.055586:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714612992:0@lo:400:kworker.0 00010000:00080000:0.0:1789050003.055594:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae795880 x1875954714613504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.055601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714613504:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714612224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.056174:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714612736:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.056277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714613248:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.056318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714613760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050003.056340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.056375:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613760 00000100:00100000:0.0:1789050003.056380:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613760 00000100:00100000:0.0:1789050003.056413:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050003.056420:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714613760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050003.056435:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050003.056469:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714613760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.056475:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050003.056493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612224 00000100:00100000:0.0:1789050003.056497:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612224 00000100:00100000:0.0:1789050003.056524:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612736 00000100:00100000:0.0:1789050003.056526:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612736 00000100:00100000:0.0:1789050003.056539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613248 00000100:00100000:0.0:1789050003.056541:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613248 00000100:00100000:0.0:1789050003.056556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789050003.056562:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714612224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056593:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714612224:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.056600:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789050003.056611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789050003.056617:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714612736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056644:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714612736:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.056650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789050003.056661:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789050003.056666:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714613248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056691:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714613248:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.056696:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789050003.056728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714612224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714612736:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.056758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714613248:0@lo:400:kworker.0 00010000:00080000:0.0:1789050003.056768:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c380 x1875954714613760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050003.056781:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714613760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050003.057064:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.057090:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612352 00000100:00100000:3.0:1789050003.057095:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612352 00000100:00100000:3.0:1789050003.057115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612608 00000100:00100000:3.0:1789050003.057117:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612608 00000100:00100000:3.0:1789050003.057128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050003.057133:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714612352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057168:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714612352:12345-0@lo:400:kworker.0 Request processed in 35us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.057173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050003.057188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789050003.057193:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714612608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.057327:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714612352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057397:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714612608:12345-0@lo:400:kworker.0 Request processed in 203us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.057403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789050003.057435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714612096 00000100:00100000:3.0:1789050003.057438:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714612096 00000100:00100000:3.0:1789050003.057468:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050003.057475:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714612096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057505:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714612096:12345-0@lo:400:kworker.0 Request processed in 32us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.057511:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050003.057543:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714612608:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057552:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714613120:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.057597:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613120 00000100:00100000:3.0:1789050003.057600:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613120 00000100:00100000:3.0:1789050003.057624:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789050003.057631:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714613120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057659:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714613120:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.057665:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789050003.057690:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae709500 x1875954714613120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050003.057699:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714613120:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057705:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714613632:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057744:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.057767:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613632 00000100:00100000:3.0:1789050003.057770:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613632 00000100:00100000:3.0:1789050003.057791:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789050003.057796:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714613632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.057822:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714613632:12345-0@lo:400:kworker.0 Request processed in 26us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.057827:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789050003.057849:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae795f80 x1875954714613632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050003.058996:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714613632:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.059048:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714612096:0@lo:400:kworker.0 00000100:00080000:2.0:1789050003.059249:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050003.059255:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050003.059258:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789050003.571077:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050003.865503:0:10938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing yml_node 00000100:00100000:2.0:1789050003.932363:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050003.932413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050003.932458:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050003.932491:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064896 00000100:00100000:2.0:1789050003.932501:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064896 00000100:00100000:2.0:1789050003.932562:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065024 00000100:00100000:2.0:1789050003.932565:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065024 00000100:00100000:2.0:1789050003.932587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:2.0:1789050003.932595:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704064896:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050003.932665:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704064896:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050003.932673:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:2.0:1789050003.932689:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789050003.932695:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704065024:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050003.932718:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704065024:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050003.932723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00080000:2.0:1789050003.932748:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050003.932752:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050003.932889:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064768 00000100:00100000:1.0:1789050003.932894:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064768 00000100:00100000:1.0:1789050003.932956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 275 00000100:00100000:1.0:1789050003.932964:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704064768:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050003.933002:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704064768:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050003.933008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 275 00000100:00100000:2.0:1789050003.933652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050003.933718:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065152 00000100:00100000:3.0:1789050003.933723:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065152 00000100:00100000:3.0:1789050003.933787:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:3.0:1789050003.933839:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704065152:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:3.0:1789050003.933870:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57398 00000100:00080000:3.0:1789050003.933880:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ba98274b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050003.933925:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789050003.934090:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+2:2402:x1875954704065152:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 296us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.934098:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00010000:00010000:3.0:1789050003.934156:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050003.934293:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050003.946029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050003.946158:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065280 00000100:00100000:3.0:1789050003.946168:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065280 00000100:00100000:3.0:1789050003.946256:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789050003.946266:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704065280:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:3.0:1789050003.946306:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5739f 00000100:00080000:3.0:1789050003.946315:0:8629:0:(import.c:65:import_set_state_nolock()) ffff8ba98274f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050003.946360:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789050003.946512:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+2:2402:x1875954704065280:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 246us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.946519:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00010000:00010000:1.0:1789050003.946694:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789050003.946843:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789050004.585534:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050005.612368:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714613888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050005.612443:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050005.613052:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714613888 00000100:00100000:3.0:1789050005.613061:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714613888 00000100:00100000:3.0:1789050005.613121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789050005.613131:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714613888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050005.613168:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050005.613235:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714613888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050005.613242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789050005.613402:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714613888:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789050005.621829:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050006.121409:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050006.121440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714614016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050006.121530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050006.121668:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614016 00000100:00100000:3.0:1789050006.121679:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614016 00000100:00100000:3.0:1789050006.121760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789050006.121772:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714614016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050006.121815:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050006.121888:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714614016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050006.121896:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050006.122885:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714614016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050006.633244:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050007.657136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050007.662085:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714614144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050007.662179:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050007.662275:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614144 00000100:00100000:0.0:1789050007.662286:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614144 00000100:00100000:0.0:1789050007.662349:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789050007.662362:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714614144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050007.662399:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050007.662451:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714614144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050007.662458:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789050007.662482:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050007.662521:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ad80 x1875954714614144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050007.662802:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714614272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050007.662836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050007.662878:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614272 00000100:00100000:2.0:1789050007.662883:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614272 00000100:00100000:2.0:1789050007.662917:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789050007.662924:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714614272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050007.662951:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050007.662980:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714614272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050007.662986:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789050007.663011:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a3800 x1875954714614272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050007.663026:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714614272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789050007.663053:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050007.663111:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714614144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050008.169248:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714614400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050008.169351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.169447:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614400 00000100:00100000:0.0:1789050008.169456:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614400 00000100:00100000:0.0:1789050008.169530:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050008.169541:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714614400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050008.169577:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050008.169627:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714614400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050008.169635:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789050008.169658:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789050008.169696:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ad80 x1875954714614400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050008.169729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714614400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050008.170482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714614656:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.170546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.170575:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714615168:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.170599:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.170616:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714615680:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.170635:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.170655:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789050008.170661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714614784:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.170903:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714614528:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.170985:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.171021:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615040:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.171065:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615552:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614528 00000100:00100000:1.0:1789050008.171081:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614528 00000100:00100000:3.0:1789050008.171087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.171104:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714616064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050008.171126:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789050008.171127:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050008.171135:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714614528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171143:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789050008.171148:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714614912:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171168:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050008.171179:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714614528:12345-0@lo:400:kworker.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.171183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714615424:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789050008.171201:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.171216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615936:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171225:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615552 00000100:00100000:1.0:1789050008.171229:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615552 00000100:00100000:3.0:1789050008.171232:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050008.171265:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615424 00000100:00100000:1.0:1789050008.171276:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615424 00000100:00100000:1.0:1789050008.171293:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615936 00000100:00100000:1.0:1789050008.171296:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615936 00000100:00100000:1.0:1789050008.171322:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789050008.171328:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171361:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615552:12345-0@lo:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.171366:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789050008.171377:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050008.171382:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714615424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171406:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714615424:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.171411:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050008.171418:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714614528:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171420:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050008.171426:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615936:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789050008.171432:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f4e00 x1875954714615552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050008.171444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615552:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.171448:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615936:12345-0@lo:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.171453:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789050008.171465:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f7b80 x1875954714615424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789050008.171471:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050008.171473:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714615424:0@lo:400:kworker.0 00010000:00080000:3.0:1789050008.171482:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7d50a80 x1875954714615936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050008.171503:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615936:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171531:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614656 00000100:00100000:3.0:1789050008.171536:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614656 00000100:00100000:3.0:1789050008.171558:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615168 00000100:00100000:3.0:1789050008.171560:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615168 00000100:00100000:3.0:1789050008.171575:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615680 00000100:00100000:3.0:1789050008.171578:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615680 00000100:00100000:3.0:1789050008.171589:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614912 00000100:00100000:3.0:1789050008.171591:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614912 00000100:00100000:3.0:1789050008.171601:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789050008.171607:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714614656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171639:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714614656:12345-0@lo:400:kworker.0 Request processed in 32us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.171645:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789050008.171663:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789050008.171668:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714615168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789050008.171692:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050008.171695:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714615168:12345-0@lo:400:kworker.0 Request processed in 27us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.171712:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789050008.171724:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789050008.171730:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171756:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714615680:12345-0@lo:400:kworker.0 Request processed in 27us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.171763:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789050008.171775:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789050008.171780:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714614912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.171829:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714614912:12345-0@lo:400:kworker.0 Request processed in 48us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.171835:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789050008.171903:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714614912:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.173846:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.173911:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714615296:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.173990:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.174016:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714615808:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.174076:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714614656:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714615168:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174112:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714615680:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174163:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615296 00000100:00100000:0.0:1789050008.174169:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615296 00000100:00100000:0.0:1789050008.174220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615808 00000100:00100000:0.0:1789050008.174222:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615808 00000100:00100000:0.0:1789050008.174237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789050008.174245:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714615296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174303:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714615296:12345-0@lo:400:kworker.0 Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050008.174312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789050008.174329:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789050008.174335:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714615808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.174361:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714615808:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050008.174367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050008.174382:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714615040 00000100:00100000:1.0:1789050008.174387:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714615040 00010000:00080000:0.0:1789050008.174401:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f5880 x1875954714615296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050008.174411:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714614784 00000100:00100000:0.0:1789050008.174413:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714615296:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.174414:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714614784 00010000:00080000:0.0:1789050008.174422:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f5f80 x1875954714615808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050008.174428:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789050008.174431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714615808:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.174435:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789050008.174496:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050008.174499:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714615040:12345-0@lo:400:kworker.0 Request processed in 65us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.174506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789050008.174523:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714615040:0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.174531:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789050008.174538:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050008.174576:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714614784:12345-0@lo:400:kworker.0 Request processed in 39us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.174582:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050008.174591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714614784:0@lo:400:kworker.0 00000100:00100000:2.0:1789050008.177167:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616064 00000100:00100000:2.0:1789050008.177186:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616064 00000100:00100000:2.0:1789050008.177268:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789050008.177280:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714616064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050008.177309:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050008.177417:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714616064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050008.177424:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789050008.177502:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ed80 x1875954714616064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050008.177573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714616064:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789050008.342731:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789050008.683409:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050009.034347:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050009.034395:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050009.034430:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050009.034471:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065664 00000100:00100000:3.0:1789050009.034486:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065664 00000100:00100000:3.0:1789050009.034554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065536 00000100:00100000:3.0:1789050009.034558:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065536 00000100:00100000:3.0:1789050009.034584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:3.0:1789050009.034597:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704065664:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050009.034680:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704065664:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050009.034689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:3.0:1789050009.034726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:3.0:1789050009.034734:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704065536:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050009.034761:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704065536:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050009.034767:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00080000:3.0:1789050009.034787:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050009.034792:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050009.035055:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065408 00000100:00100000:2.0:1789050009.035061:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065408 00000100:00100000:2.0:1789050009.035099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 277 00000100:00100000:2.0:1789050009.035120:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2403:x1875954704065408:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050009.035157:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2403:x1875954704065408:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050009.035164:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 277 00010000:00010000:1.0:1789050009.705140:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789050009.709711:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:3.0:1789050009.709724:0:8427:0:(genops.c:885:class_export_put()) final put ffff8ba98274d800/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:1.0:1789050009.709879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274d800/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-OST0000 00000020:00000080:1.0:1789050009.710056:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274b800 for lustre-OST0000 00000001:00100000:1.0:1789050009.710337:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:1.0:1789050009.710342:0:9512:0:(genops.c:885:class_export_put()) final put ffff8ba982748000/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:0.0:1789050009.710403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982748000/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-OST0001 00000020:00000080:0.0:1789050009.710443:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274f800 for lustre-OST0001 00000001:02000400:0.0:1789050010.678826:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1789050010.730041:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050010.730065:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050010.730097:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714616192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050010.730469:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050010.730655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616192 00000100:00100000:1.0:1789050010.730664:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616192 00000100:00100000:1.0:1789050010.730772:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789050010.730794:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714616192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050010.730834:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050010.730914:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714616192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050010.730920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789050010.731007:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714616192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050011.241156:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050011.241281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714616320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050011.241351:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050011.241537:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616320 00000100:00100000:3.0:1789050011.241543:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616320 00000100:00100000:1.0:1789050011.241642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789050011.241653:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714616320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050011.241701:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789050011.241787:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714616320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.241794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789050011.241796:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714616320:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050011.753092:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050012.614283:0:11316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:3.0:1789050012.779130:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714616448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050012.779208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.784274:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616448 00000100:00100000:0.0:1789050012.784294:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616448 00000100:00100000:0.0:1789050012.784360:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050012.784371:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714616448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050012.784403:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050012.784496:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714616448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (5287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050012.784504:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789050012.784526:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050012.784564:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f6300 x1875954714616448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050012.784566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714616576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050012.784590:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714616448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050012.784614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.784639:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616576 00000100:00100000:0.0:1789050012.784643:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616576 00000100:00100000:0.0:1789050012.784691:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789050012.784698:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714616576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050012.784707:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050012.784746:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714616576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050012.784764:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789050012.784778:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789050012.785148:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a1500 x1875954714616576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050012.785161:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714616576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789050012.786343:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050013.289109:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050013.289135:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714616704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050013.289204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050013.289273:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616704 00000100:00100000:0.0:1789050013.289280:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616704 00000100:00100000:0.0:1789050013.289331:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789050013.289341:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714616704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050013.289370:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050013.289415:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714616704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050013.289423:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789050013.289444:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789050013.289472:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8380 x1875954714616704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050013.289490:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714616704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050013.289786:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714616960:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.289818:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.289840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714617472:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.289861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.289878:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714617984:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.289899:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.289917:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789050013.289923:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714617088:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.289963:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.289980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714617600:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.290013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.290034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714618112:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.290055:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.290142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616960 00000100:00100000:1.0:1789050013.290147:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616960 00000100:00100000:1.0:1789050013.290178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617472 00000100:00100000:1.0:1789050013.290182:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617472 00000100:00100000:1.0:1789050013.290204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617984 00000100:00100000:1.0:1789050013.290206:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617984 00000100:00100000:1.0:1789050013.290220:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617600 00000100:00100000:1.0:1789050013.290223:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617600 00000100:00100000:1.0:1789050013.290235:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618112 00000100:00100000:1.0:1789050013.290237:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618112 00000100:00100000:1.0:1789050013.290251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050013.290258:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714616960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.290296:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714616960:12345-0@lo:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.290304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050013.290318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789050013.290324:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714617472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.290352:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714617472:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.290359:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789050013.290370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789050013.290376:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714617984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.290399:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714617984:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.290405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789050013.290416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789050013.290422:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714617600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290602:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714617216:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290646:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714617728:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714618240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789050013.290756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714616832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290782:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290804:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714617344:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290834:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290850:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714617856:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.290870:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.290900:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617728 00000100:00100000:2.0:1789050013.290904:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617728 00000100:00100000:2.0:1789050013.290932:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618240 00000100:00100000:2.0:1789050013.290961:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618240 00000100:00100000:2.0:1789050013.290979:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617856 00000100:00100000:2.0:1789050013.290983:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617856 00000100:00100000:2.0:1789050013.290996:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050013.291003:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baabdf32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714617728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291039:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baabdf32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714617728:12345-0@lo:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291045:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050013.291253:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050013.291260:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714618240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291290:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714618240:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291296:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050013.291307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789050013.291312:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714617856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291335:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714617856:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291340:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789050013.291356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714616832 00000100:00100000:2.0:1789050013.291360:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714616832 00000100:00100000:2.0:1789050013.291383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789050013.291393:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714616832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291421:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714616832:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789050013.291450:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617088 00000100:00100000:2.0:1789050013.291454:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617088 00000100:00100000:2.0:1789050013.291471:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617344 00000100:00100000:2.0:1789050013.291473:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617344 00000100:00100000:2.0:1789050013.291485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789050013.291491:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714617088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291524:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714617088:12345-0@lo:400:kworker.0 Request processed in 33us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291530:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789050013.291542:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789050013.291548:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714617344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291574:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714617344:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291579:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789050013.291621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714616832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291632:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714617344:0@lo:400:kworker.0 00010000:00080000:2.0:1789050013.291643:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368fb80 x1875954714617856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.291652:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714617856:0@lo:400:kworker.0 00010000:00080000:2.0:1789050013.291660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c380 x1875954714617728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.291693:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714617728:0@lo:400:kworker.0 00010000:00080000:2.0:1789050013.291706:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ce00 x1875954714618240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.291713:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714618240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291770:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714617216 00000100:00100000:2.0:1789050013.291774:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714617216 00000100:00100000:2.0:1789050013.291793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789050013.291800:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714618112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291830:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714618112:12345-0@lo:400:kworker.0 Request processed in 31us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291836:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789050013.291848:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789050013.291854:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714617216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.291883:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714617216:12345-0@lo:400:kworker.0 Request processed in 29us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.291889:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789050013.291920:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714617216:0@lo:400:kworker.0 00000100:00080000:2.0:1789050013.291970:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050013.291974:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050013.291976:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050013.292000:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714617088:0@lo:400:kworker.0 00010000:00080000:2.0:1789050013.292012:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368f100 x1875954714618112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.292021:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714618112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.292039:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714616960:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.292048:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714617472:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.292057:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714617984:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.292181:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714617600:12345-0@lo:400:kworker.0 Request processed in 1759us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.292197:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789050013.292379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050013.292388:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714618368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050013.292414:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050013.292440:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618368 00000100:00100000:0.0:1789050013.292444:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618368 00000100:00100000:0.0:1789050013.292469:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789050013.292476:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714618368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050013.292489:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050013.292518:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714618368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050013.292530:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789050013.292558:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8380 x1875954714618368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050013.292571:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714618368:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789050013.292974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368d880 x1875954714617600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.292983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714617600:0@lo:400:kworker.0 00010000:00010000:1.0:1789050013.802186:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050013.911376:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 10:20:11 EDT 2026 00000100:00100000:3.0:1789050014.156362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050014.156415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050014.156437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065792 00000100:00100000:1.0:1789050014.156470:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065792 00000100:00100000:3.0:1789050014.156539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050014.156648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 279 00000100:00100000:1.0:1789050014.156670:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2404:x1875954704065792:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050014.156759:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2404:x1875954704065792:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 100us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050014.156767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 279 00000100:00100000:2.0:1789050014.169742:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066048 00000100:00100000:2.0:1789050014.169768:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066048 00000100:00100000:1.0:1789050014.170038:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065920 00000100:00100000:1.0:1789050014.170052:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065920 00000100:00100000:1.0:1789050014.170106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:1.0:1789050014.170118:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704066048:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:2.0:1789050014.170140:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050014.170147:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050014.170216:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704066048:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 101us (13801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050014.170722:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:3.0:1789050014.170740:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704065920:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050014.170774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:3.0:1789050014.170869:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704065920:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 134us (14329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050014.170879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 98 00010000:00010000:3.0:1789050014.827586:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050015.849180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714618496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050015.849679:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050015.849842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618496 00000100:00100000:3.0:1789050015.849853:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618496 00000100:00100000:3.0:1789050015.849914:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789050015.849925:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714618496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050015.849990:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050015.850048:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714618496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050015.850056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050015.850195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714618496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789050015.851333:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050016.365892:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050016.367336:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714618624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050016.367430:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050016.367568:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618624 00000100:00100000:3.0:1789050016.367578:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618624 00000100:00100000:3.0:1789050016.367677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789050016.367688:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714618624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050016.367729:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050016.367792:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714618624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050016.367810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050016.367892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714618624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789050016.876723:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050017.898916:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050017.900350:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714618752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050017.900449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050017.900553:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618752 00000100:00100000:1.0:1789050017.900564:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618752 00000100:00100000:1.0:1789050017.901830:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789050017.901851:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714618752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050017.901890:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050017.901979:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714618752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050017.901994:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789050017.902031:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050017.902140:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714618880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050017.902183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050017.902346:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714618880 00000100:00100000:0.0:1789050017.902354:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714618880 00000100:00100000:0.0:1789050017.902405:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789050017.902412:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714618880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050017.902424:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050017.902456:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714618880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050017.902462:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789050017.902813:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837caa00 x1875954714618880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050017.902838:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714618880:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789050017.902887:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789050017.903109:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8a80 x1875954714618752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050017.903127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714618752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050018.409107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714619008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050018.409181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.409267:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619008 00000100:00100000:0.0:1789050018.409275:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619008 00000100:00100000:0.0:1789050018.409351:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789050018.409362:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714619008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050018.409392:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050018.409455:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714619008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.409478:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789050018.409560:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8700 x1875954714619008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050018.409579:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714619008:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789050018.410575:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050018.410828:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050018.410841:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714619136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050018.410892:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.410933:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619136 00000100:00100000:2.0:1789050018.410968:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619136 00000100:00100000:2.0:1789050018.411020:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789050018.411030:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714619136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050018.411046:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050018.411081:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714619136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.411089:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789050018.411106:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050018.411127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a1f80 x1875954714619136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050018.411142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714619136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050018.411700:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714619264:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.411741:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.411773:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714619776:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.411802:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.411824:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050018.411829:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714619392:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.411855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.411873:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714619904:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.411892:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.411920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619392 00000100:00100000:0.0:1789050018.411924:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619392 00000100:00100000:0.0:1789050018.413416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619904 00000100:00100000:0.0:1789050018.413425:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619904 00000100:00100000:0.0:1789050018.413469:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789050018.413481:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714619392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.413757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050018.413772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714620288:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.413827:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.413861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619264 00000100:00100000:2.0:1789050018.413865:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619264 00000100:00100000:2.0:1789050018.413896:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789050018.413902:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714619264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.413951:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714619264:12345-0@lo:400:kworker.0 Request processed in 33us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.413958:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789050018.413992:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619776 00000100:00100000:2.0:1789050018.413996:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619776 00000100:00100000:2.0:1789050018.414022:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789050018.414029:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714619776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.414064:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714619776:12345-0@lo:400:kworker.0 Request processed in 36us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.414084:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789050018.414106:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714619648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.414137:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.414151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714620160:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.414168:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.414180:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789050018.414185:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714619520:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.414205:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.414222:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714620032:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.414759:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714619392:12345-0@lo:400:kworker.0 Request processed in 1280us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.414768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789050018.414785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620288 00000100:00100000:0.0:1789050018.414790:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620288 00000100:00100000:0.0:1789050018.414819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619648 00000100:00100000:0.0:1789050018.414823:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619648 00000100:00100000:0.0:1789050018.414836:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620160 00000100:00100000:0.0:1789050018.414839:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620160 00000100:00100000:0.0:1789050018.414858:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789050018.414864:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714619904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.414898:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714619904:12345-0@lo:400:kworker.0 Request processed in 35us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.414905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789050018.414914:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789050018.414920:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714620288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.414972:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714620288:12345-0@lo:400:kworker.0 Request processed in 52us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.414978:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789050018.414989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789050018.414994:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714619648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415019:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714619648:12345-0@lo:400:kworker.0 Request processed in 25us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.415025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789050018.415035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789050018.415041:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714620160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415063:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714620160:12345-0@lo:400:kworker.0 Request processed in 23us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.415069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789050018.415122:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c000 x1875954714620288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050018.415150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714620288:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415205:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714619392:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415216:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714619904:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415225:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714619264:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.415234:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714619776:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.416611:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.416694:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714619648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.416708:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714620160:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.416744:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714619520 00000100:00100000:2.0:1789050018.416750:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714619520 00000100:00100000:2.0:1789050018.416799:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789050018.416807:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714619520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.416869:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714619520:12345-0@lo:400:kworker.0 Request processed in 63us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.416877:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789050018.416907:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714619520:0@lo:400:kworker.0 00000100:00080000:2.0:1789050018.416922:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050018.416928:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050018.417071:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620032 00000100:00100000:1.0:1789050018.417076:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620032 00000100:00100000:1.0:1789050018.417118:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789050018.417124:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714620032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050018.417162:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714620032:12345-0@lo:400:kworker.0 Request processed in 38us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050018.417168:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789050018.417199:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a0000 x1875954714620032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050018.417211:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714620032:0@lo:400:kworker.0 00000100:00080000:1.0:1789050018.417227:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789050018.921267:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050019.271875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050019.271932:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050019.271987:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050019.272029:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066432 00000100:00100000:3.0:1789050019.272041:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066432 00000100:00100000:2.0:1789050019.272068:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066304 00000100:00100000:2.0:1789050019.272075:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066304 00000100:00100000:0.0:1789050019.272160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066176 00000100:00100000:0.0:1789050019.272165:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066176 00000100:00100000:2.0:1789050019.272192:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:2.0:1789050019.272206:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704066432:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050019.272211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 281 00000100:00100000:0.0:1789050019.272224:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704066176:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050019.272286:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:2.0:1789050019.272297:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704066432:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050019.272299:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704066304:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050019.272313:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:0.0:1789050019.273703:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704066176:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1467us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050019.273718:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 281 00000100:00100000:3.0:1789050019.273845:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704066304:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1549us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050019.273854:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00080000:3.0:1789050019.273880:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050019.273887:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789050019.948889:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050020.969213:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050020.969238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714620416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050020.969312:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789050020.969470:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050020.969705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620416 00000100:00100000:2.0:1789050020.969714:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620416 00000100:00100000:2.0:1789050020.969774:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789050020.969785:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714620416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050020.969824:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789050020.969880:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714620416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050020.969887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789050020.970018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714620416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050021.481689:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050021.481716:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714620544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050021.481805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050021.482156:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620544 00000100:00100000:0.0:1789050021.482165:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620544 00000100:00100000:0.0:1789050021.482220:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789050021.482230:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714620544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050021.482289:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050021.482351:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714620544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050021.482358:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789050021.482548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714620544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050021.994076:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050023.018139:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050023.018183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714620672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050023.018250:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.018501:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620672 00000100:00100000:2.0:1789050023.018508:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620672 00000100:00100000:2.0:1789050023.018568:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050023.018579:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714620672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050023.018621:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050023.018668:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714620672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.018675:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050023.018695:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050023.018703:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714620800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050023.019117:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050023.019239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789050023.020123:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8e00 x1875954714620672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050023.020147:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714620672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050023.022546:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620800 00000100:00100000:0.0:1789050023.022557:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620800 00000100:00100000:0.0:1789050023.022687:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050023.022697:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714620800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050023.022724:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050023.022862:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714620800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050023.022878:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789050023.022901:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050023.022934:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837ca300 x1875954714620800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050023.022970:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714620800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050023.531232:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714620928:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714621440:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531398:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531418:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714621952:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789050023.531468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714621312:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531486:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714621824:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531519:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531544:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714621056:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531581:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714621568:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531625:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714622080:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531645:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531663:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789050023.531668:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714621184:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531686:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531701:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714621696:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531729:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714622208:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531748:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.531779:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714620928 00000100:00100000:2.0:1789050023.531793:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714620928 00000100:00100000:2.0:1789050023.531843:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789050023.531854:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714620928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.531906:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714620928:12345-0@lo:400:kworker.0 Request processed in 54us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.531913:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789050023.531972:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621440 00000100:00100000:2.0:1789050023.531976:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621440 00000100:00100000:2.0:1789050023.531994:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621184 00000100:00100000:2.0:1789050023.531997:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621184 00000100:00100000:2.0:1789050023.532010:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789050023.532015:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714621440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532050:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714621440:12345-0@lo:400:kworker.0 Request processed in 34us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789050023.532069:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789050023.532075:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714621184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532106:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714621184:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532111:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789050023.532126:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621952 00000100:00100000:2.0:1789050023.532130:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621952 00000100:00100000:2.0:1789050023.532159:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621312 00000100:00100000:2.0:1789050023.532161:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621312 00000100:00100000:2.0:1789050023.532170:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621824 00000100:00100000:2.0:1789050023.532172:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621824 00000100:00100000:2.0:1789050023.532182:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621056 00000100:00100000:2.0:1789050023.532185:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621056 00000100:00100000:2.0:1789050023.532194:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621568 00000100:00100000:2.0:1789050023.532202:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621568 00000100:00100000:2.0:1789050023.532217:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714621696 00000100:00100000:2.0:1789050023.532219:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714621696 00000100:00100000:2.0:1789050023.532231:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789050023.532236:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714621952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532264:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714621952:12345-0@lo:400:kworker.0 Request processed in 28us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532270:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789050023.532280:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789050023.532285:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714621312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532306:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714621312:12345-0@lo:400:kworker.0 Request processed in 21us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532312:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789050023.532321:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789050023.532326:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714621824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532349:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714621824:12345-0@lo:400:kworker.0 Request processed in 23us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532354:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789050023.532363:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789050023.532369:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714621056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532390:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714621056:12345-0@lo:400:kworker.0 Request processed in 22us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532395:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789050023.532405:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789050023.532411:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714621568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532437:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714621568:12345-0@lo:400:kworker.0 Request processed in 26us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532449:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789050023.532462:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789050023.532468:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714621696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532495:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714621696:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532500:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789050023.532526:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622080 00000100:00100000:2.0:1789050023.532529:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622080 00000100:00100000:2.0:1789050023.532552:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622208 00000100:00100000:2.0:1789050023.532555:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622208 00000100:00100000:2.0:1789050023.532572:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789050023.532577:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714622080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532617:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714622080:12345-0@lo:400:kworker.0 Request processed in 40us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532623:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789050023.532634:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789050023.532641:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714622208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532665:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714622208:12345-0@lo:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050023.532670:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789050023.532696:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050023.532701:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050023.532703:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050023.532734:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714621184:0@lo:400:kworker.0 00010000:00080000:2.0:1789050023.532749:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd6680 x1875954714621696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050023.532770:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714621696:0@lo:400:kworker.0 00010000:00080000:2.0:1789050023.532783:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709500 x1875954714622208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050023.532791:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714622208:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714621056:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714621568:0@lo:400:kworker.0 00010000:00080000:2.0:1789050023.532815:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709180 x1875954714622080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050023.532822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714622080:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714621312:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714621824:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532872:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714620928:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.532879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714621440:0@lo:400:kworker.0 00010000:00080000:2.0:1789050023.532887:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709c00 x1875954714621952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050023.532895:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714621952:0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.533042:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050023.533051:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714622336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050023.533085:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050023.533115:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622336 00000100:00100000:3.0:1789050023.533119:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622336 00000100:00100000:3.0:1789050023.533147:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789050023.533154:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714622336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050023.533175:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050023.533225:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714622336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050023.533232:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789050023.533264:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f5880 x1875954714622336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050023.533276:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714622336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050023.533397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9834a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714622464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050023.533420:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050023.533456:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622464 00000100:00100000:1.0:1789050023.533462:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622464 00000100:00100000:1.0:1789050023.533496:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789050023.533503:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714622464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050023.533515:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050023.533561:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714622464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050023.533580:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789050023.533617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9834a4e00 x1875954714622464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050023.533807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9834a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714622464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789050024.041243:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050024.396841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050024.396876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050024.396898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050024.396922:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066560 00000100:00100000:3.0:1789050024.396930:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066560 00000100:00100000:3.0:1789050024.396997:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 283 00000100:00100000:3.0:1789050024.397006:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2406:x1875954704066560:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050024.397298:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2406:x1875954704066560:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 292us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050024.397306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 283 00000100:00100000:3.0:1789050024.398622:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066816 00000100:00100000:3.0:1789050024.398633:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066816 00000100:00100000:3.0:1789050024.398686:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066688 00000100:00100000:3.0:1789050024.398689:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066688 00000100:00100000:3.0:1789050024.399092:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:3.0:1789050024.399105:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704066816:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050024.399170:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704066816:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 68us (2292us total) trans 0 rc 0/0 00000100:00080000:0.0:1789050024.401097:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050024.401106:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050024.403918:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:1.0:1789050024.403954:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704066688:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050024.404052:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704066688:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 121us (7151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050024.404061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:3.0:1789050024.404687:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 113 00010000:00010000:0.0:1789050025.065466:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050026.089609:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714622592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050026.089702:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050026.094781:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050026.094818:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622592 00000100:00100000:2.0:1789050026.094834:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622592 00000100:00100000:2.0:1789050026.094909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789050026.094965:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714622592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050026.095011:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789050026.099677:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714622592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4724us (9959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050026.099683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714622592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050026.099698:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789050026.602161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714622720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050026.602356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050026.603079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622720 00000100:00100000:2.0:1789050026.603091:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622720 00000100:00100000:2.0:1789050026.603485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789050026.603499:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714622720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050026.603544:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050026.603704:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714622720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050026.603712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789050026.603802:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714622720:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789050027.113752:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050028.140000:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050028.144207:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714622848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050028.144295:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.144881:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622848 00000100:00100000:3.0:1789050028.144891:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622848 00000100:00100000:3.0:1789050028.144985:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789050028.145006:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714622848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050028.145041:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050028.145098:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714622848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.145107:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789050028.145171:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837caa00 x1875954714622848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.145189:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714622848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050028.146149:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050028.147921:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050028.161357:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714622976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050028.161584:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.161641:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714622976 00000100:00100000:3.0:1789050028.161650:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714622976 00000100:00100000:3.0:1789050028.162930:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050028.162962:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714622976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050028.163567:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050028.163647:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714622976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 694us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.163656:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789050028.164586:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789050028.164672:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01180 x1875954714622976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.165573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714622976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050028.654857:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714623104:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.654964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.655228:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714623232:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.655614:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714623616:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656185:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656218:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714623744:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656258:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624256:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656317:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714623360:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656343:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656363:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714623872:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656381:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789050028.656435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714623488:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656451:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656465:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714624000:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9834a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714624512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050028.656527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.656598:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623232 00000100:00100000:3.0:1789050028.656615:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623232 00000100:00100000:3.0:1789050028.656664:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623744 00000100:00100000:3.0:1789050028.656667:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623744 00000100:00100000:3.0:1789050028.656706:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623872 00000100:00100000:3.0:1789050028.656709:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623872 00000100:00100000:3.0:1789050028.656720:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623488 00000100:00100000:3.0:1789050028.656721:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623488 00000100:00100000:3.0:1789050028.656731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624000 00000100:00100000:3.0:1789050028.656732:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624000 00000100:00100000:3.0:1789050028.656749:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789050028.656758:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714623232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656810:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714623232:12345-0@lo:400:kworker.0 Request processed in 52us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.656817:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789050028.656838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789050028.656844:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714623744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656869:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714623744:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.656875:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789050028.656886:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789050028.656892:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714623872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.656923:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714623872:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.656929:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789050028.656961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789050028.656967:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714623488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.657005:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714623488:12345-0@lo:400:kworker.0 Request processed in 38us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623360 00000100:00100000:0.0:1789050028.657169:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623360 00000100:00100000:0.0:1789050028.657199:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789050028.657205:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714623360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.657241:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714623360:12345-0@lo:400:kworker.0 Request processed in 37us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789050028.657384:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624512 00000100:00100000:0.0:1789050028.657389:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624512 00000100:00100000:0.0:1789050028.657419:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789050028.657426:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714624512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050028.657453:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050028.657485:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714624512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657491:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789050028.657576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789050028.657585:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714624000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.657618:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714624000:12345-0@lo:400:kworker.0 Request processed in 36us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789050028.657645:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624256 00000100:00100000:0.0:1789050028.657649:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624256 00000100:00100000:0.0:1789050028.657674:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624384 00000100:00100000:0.0:1789050028.657677:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624384 00000100:00100000:0.0:1789050028.657694:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789050028.657700:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.657728:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624256:12345-0@lo:400:kworker.0 Request processed in 29us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657734:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789050028.657744:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050028.657749:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714624384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.657772:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714624384:12345-0@lo:400:kworker.0 Request processed in 23us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657777:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789050028.657828:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050028.657833:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050028.657835:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050028.657856:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623104 00000100:00100000:0.0:1789050028.657860:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623104 00000100:00100000:0.0:1789050028.657884:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789050028.657890:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714623104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.657922:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714623104:12345-0@lo:400:kworker.0 Request processed in 32us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.657928:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789050028.658175:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789050028.658223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714623232:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.658235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714623744:0@lo:400:kworker.0 00010000:00080000:3.0:1789050028.658248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c000 x1875954714624256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.658260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624256:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.658280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050028.658289:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050028.658317:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050028.658352:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714623488:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.658363:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714624000:0@lo:400:kworker.0 00010000:00080000:3.0:1789050028.658375:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9834a5c00 x1875954714624512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.658390:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9834a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714624512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050028.658401:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714623360:0@lo:400:kworker.0 00010000:00080000:3.0:1789050028.658412:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ed80 x1875954714623872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.658421:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714623872:0@lo:400:kworker.0 00010000:00080000:3.0:1789050028.658429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c380 x1875954714624384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.658436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.658471:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624640 00000100:00100000:3.0:1789050028.658475:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624640 00000100:00100000:3.0:1789050028.658498:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050028.658516:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050028.658528:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050028.658569:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050028.658575:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789050028.658601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832f5880 x1875954714624640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.658613:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050028.665639:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050028.665705:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714624128:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.665752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050028.665806:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714623104:0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.666052:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714623616 00000100:00100000:0.0:1789050028.666061:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714623616 00000100:00100000:0.0:1789050028.666112:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789050028.666121:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714623616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.666194:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714623616:12345-0@lo:400:kworker.0 Request processed in 74us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.666202:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789050028.666227:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624128 00000100:00100000:0.0:1789050028.666230:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624128 00000100:00100000:0.0:1789050028.666268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789050028.666273:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714624128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050028.666311:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714624128:12345-0@lo:400:kworker.0 Request processed in 27us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050028.666317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789050028.666333:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050028.666443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714623616:0@lo:400:kworker.0 00010000:00080000:3.0:1789050028.666457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368c700 x1875954714624128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050028.666468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714624128:0@lo:400:kworker.0 00000001:02000400:1.0:1789050028.844459:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:20:26 (1789050026) === 00010000:00010000:2.0:1789050029.163339:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050029.170189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050029.170313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066944 00000100:00100000:3.0:1789050029.170331:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066944 00000100:00100000:3.0:1789050029.170480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 285 00000100:00100000:3.0:1789050029.170493:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:8754:x1875954704066944:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789050029.170514:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050029.170536:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602600/0x3b8ec5973df5748d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad39669aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050029.170586:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602600/0x3b8ec5973df5748d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669aa expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050029.170621:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602600/0x3b8ec5973df5748d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669aa expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050029.170631:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602600, rc 0) 00000100:00100000:3.0:1789050029.170736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704066944:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 246us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.170744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 285 00000100:00100000:2.0:1789050029.190304:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.191036:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067072 00000100:00100000:0.0:1789050029.191054:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067072 00000100:00100000:0.0:1789050029.191144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 286 00000100:00100000:0.0:1789050029.191157:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704067072:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789050029.191361:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704067072:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 207us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.191369:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 286 00000100:00100000:1.0:1789050029.196140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050029.196437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067200 00000100:00100000:3.0:1789050029.196450:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067200 00000100:00100000:3.0:1789050029.196516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 287 00000100:00100000:3.0:1789050029.196529:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704067200:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789050029.201725:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704067200:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 2147us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.202356:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 287 00000100:00100000:1.0:1789050029.210273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.211805:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067328 00000100:00100000:2.0:1789050029.211820:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067328 00000100:00100000:2.0:1789050029.211915:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 288 00000100:00100000:2.0:1789050029.211974:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067328:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050029.212212:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067328:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 287us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.212221:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 288 00000100:00100000:2.0:1789050029.248550:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050029.248653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067456 00000100:00100000:3.0:1789050029.248667:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067456 00000100:00100000:3.0:1789050029.248745:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 289 00000100:00100000:3.0:1789050029.248765:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067456:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050029.249276:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067456:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 511us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.249285:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 289 00000100:00100000:1.0:1789050029.261303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.261443:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067584 00000100:00100000:0.0:1789050029.261458:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067584 00000100:00100000:0.0:1789050029.261532:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00100000:0.0:1789050029.261546:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067584:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050029.261781:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8758:x1875954704067584:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.261790:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00100000:1.0:1789050029.267439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.267572:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067712 00000100:00100000:2.0:1789050029.267585:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067712 00000100:00100000:2.0:1789050029.267703:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 291 00000100:00100000:2.0:1789050029.267716:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:8754:x1875954704067712:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050029.267736:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050029.267768:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a4000/0x3b8ec5973df57494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad39669db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.267803:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a4000/0x3b8ec5973df57494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669db expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.267814:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a4000/0x3b8ec5973df57494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669db expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.267824:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a4000, rc 0) 00000100:00100000:2.0:1789050029.267895:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:8754:x1875954704067712:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 183us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.267901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 291 00000100:00100000:3.0:1789050029.271588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.271671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067840 00000100:00100000:2.0:1789050029.271739:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067840 00000100:00100000:2.0:1789050029.271902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 292 00000100:00100000:2.0:1789050029.271914:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:8754:x1875954704067840:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789050029.272010:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789050029.272032:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789050029.272036:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789050029.272040:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789050029.272043:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789050029.272045:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789050029.274485:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:8754:x1875954704067840:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 2560us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.274499:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 292 00000100:00100000:1.0:1789050029.277333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.277424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067968 00000100:00100000:2.0:1789050029.277437:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067968 00000100:00100000:2.0:1789050029.277502:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 293 00000100:00100000:2.0:1789050029.277514:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:8754:x1875954704067968:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050029.277533:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050029.277565:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad39669e2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.277599:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.277613:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050029.277624:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae5a4400, rc 0) 00000100:00100000:2.0:1789050029.277695:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8754:x1875954704067968:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 183us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.277703:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 293 00000100:00100000:3.0:1789050029.280471:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.280569:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068096 00000100:00100000:2.0:1789050029.280597:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068096 00000100:00100000:2.0:1789050029.280666:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 294 00000100:00100000:2.0:1789050029.280678:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8754:x1875954704068096:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050029.280847:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8754:x1875954704068096:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 171us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.280853:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 294 00000100:00100000:1.0:1789050029.282748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.282817:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068224 00000100:00100000:0.0:1789050029.282826:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068224 00000100:00100000:0.0:1789050029.282869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 295 00000100:00100000:0.0:1789050029.282878:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8754:x1875954704068224:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050029.283170:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8754:x1875954704068224:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 292us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.283183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 295 00000100:00100000:1.0:1789050029.285739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.285879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068352 00000100:00100000:2.0:1789050029.286146:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068352 00000100:00100000:2.0:1789050029.286213:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 296 00000100:00100000:2.0:1789050029.286225:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8762:x1875954704068352:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050029.286462:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8762:x1875954704068352:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 238us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.286471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 296 00000100:00100000:2.0:1789050029.299164:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.299273:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068480 00000100:00100000:0.0:1789050029.299285:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068480 00000100:00100000:0.0:1789050029.299343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 297 00000100:00100000:0.0:1789050029.299354:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8762:x1875954704068480:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050029.299599:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:8762:x1875954704068480:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 245us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.299609:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 297 00000100:00100000:1.0:1789050029.308665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050029.308711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050029.308743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050029.308837:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068608 00000100:00100000:3.0:1789050029.308867:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068608 00000100:00100000:3.0:1789050029.308917:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069248 00000100:00100000:3.0:1789050029.308921:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069248 00000100:00100000:3.0:1789050029.308999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069376 00000100:00100000:3.0:1789050029.309003:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069376 00000100:00100000:3.0:1789050029.309024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:3.0:1789050029.309035:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704069248:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050029.309126:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704069248:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 92us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.309134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:3.0:1789050029.309157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:3.0:1789050029.309163:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704069376:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050029.309189:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704069376:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.309194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:3.0:1789050029.309207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:3.0:1789050029.309211:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875954704068608:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789050029.309239:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2bbaf27a-e110-4dde-9d4b-6a899944aea0@192.168.203.42@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1789050029.309277:0:6518:0:(genops.c:1384:class_connect()) connect: client 2bbaf27a-e110-4dde-9d4b-6a899944aea0, cookie 0x3b8ec5973df574a2 00000004:00100000:3.0:1789050029.309306:0:6518:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789050029.309438:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8baab7852800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050029.309470:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2402:x1875954704068608:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 256us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.309477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00080000:3.0:1789050029.309499:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050029.309503:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050029.312017:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.312061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.312180:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068864 00000100:00100000:0.0:1789050029.312192:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068864 00000100:00100000:0.0:1789050029.312240:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068736 00000100:00100000:0.0:1789050029.312244:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068736 00000100:00100000:0.0:1789050029.312303:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050029.312313:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1875954704068864:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789050029.312351:0:10357:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 2bbaf27a-e110-4dde-9d4b-6a899944aea0@192.168.203.42@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1789050029.312411:0:10357:0:(genops.c:1384:class_connect()) connect: client 2bbaf27a-e110-4dde-9d4b-6a899944aea0, cookie 0x3b8ec5973df574a9 00000004:00100000:0.0:1789050029.312439:0:10357:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1789050029.312587:0:10357:0:(import.c:65:import_set_state_nolock()) ffff8ba98274a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050029.312659:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2402:x1875954704068864:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 345us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.312668:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050029.312687:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050029.312694:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:0:x1875954704068736:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050029.312723:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789050029.312779:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:0:x1875954704068736:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 85us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.312785:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00080000:2.0:1789050029.313182:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050029.314775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.315045:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069120 00000100:00100000:0.0:1789050029.315054:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069120 00000100:00100000:0.0:1789050029.315160:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050029.315172:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069120:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050029.315202:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789050029.315275:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069120:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 105us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.315301:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789050029.321364:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050029.322758:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.324210:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068992 00000100:00100000:2.0:1789050029.324226:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068992 00000100:00100000:2.0:1789050029.324488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789050029.324500:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:0:x1875954704068992:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789050029.324548:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050029.324663:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:0:x1875954704068992:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 164us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.324671:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050029.326563:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069504 00000100:00100000:0.0:1789050029.326581:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069504 00000100:00100000:0.0:1789050029.326648:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789050029.326660:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069504:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789050029.326760:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069504:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 103us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.326768:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00080000:3.0:1789050029.329151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050029.330336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.330446:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050029.330484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050029.330575:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069632 00000100:00100000:0.0:1789050029.330587:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069632 00000100:00100000:0.0:1789050029.330631:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069760 00000100:00100000:0.0:1789050029.330634:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069760 00000100:00100000:0.0:1789050029.330659:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050029.330668:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875954704069632:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050029.330719:0:8629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2bbaf27a-e110-4dde-9d4b-6a899944aea0@192.168.203.42@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1789050029.330761:0:8629:0:(genops.c:1384:class_connect()) connect: client 2bbaf27a-e110-4dde-9d4b-6a899944aea0, cookie 0x3b8ec5973df574b0 00002000:00100000:0.0:1789050029.330779:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2bbaf27a-e110-4dde-9d4b-6a899944aea0/ffff8ba98274f000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050029.330791:0:8629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789050029.330899:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789050029.331243:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789050029.331249:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1875954704069760:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789050029.331269:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2bbaf27a-e110-4dde-9d4b-6a899944aea0@192.168.203.42@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1789050029.331288:0:8434:0:(genops.c:1384:class_connect()) connect: client 2bbaf27a-e110-4dde-9d4b-6a899944aea0, cookie 0x3b8ec5973df574b7 00002000:00100000:2.0:1789050029.331294:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2bbaf27a-e110-4dde-9d4b-6a899944aea0/ffff8ba9834d5000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789050029.331302:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789050029.331354:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789050029.331380:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8ba9834d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050029.331456:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2402:x1875954704069760:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 203us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.331464:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00080000:0.0:1789050029.331535:0:8629:0:(import.c:65:import_set_state_nolock()) ffff8ba98274d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050029.331575:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2402:x1875954704069632:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 906us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.331582:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:3.0:1789050029.333414:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069888 00000100:00100000:3.0:1789050029.333427:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069888 00000100:00100000:2.0:1789050029.333628:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:2.0:1789050029.333640:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069888:12345-192.168.203.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789050029.333734:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704069888:12345-192.168.203.42@tcp:900:mount.lustre.0 Request processed in 96us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050029.333742:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:3.0:1789050029.335785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050029.335906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070016 00000100:00100000:1.0:1789050029.335918:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070016 00000100:00100000:1.0:1789050029.336024:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:1.0:1789050029.336035:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704070016:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789050029.336146:0:6521:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789050029.336233:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:8754:x1875954704070016:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 200us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050029.336242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00010000:00010000:2.0:1789050030.185090:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050031.213792:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9834a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050031.213867:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050031.213959:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624768 00000100:00100000:1.0:1789050031.213967:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624768 00000100:00100000:1.0:1789050031.214013:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050031.214023:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050031.214070:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050031.214119:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714624768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050031.214126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050031.214172:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9834a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714624768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050031.214224:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050031.733323:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050031.733354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714624896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050031.733445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050031.733680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714624896 00000100:00100000:0.0:1789050031.733691:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714624896 00000100:00100000:0.0:1789050031.733780:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789050031.733791:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714624896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050031.733844:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050031.733972:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714624896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050031.733980:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789050031.740954:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714624896:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050032.239135:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050033.257445:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050033.257469:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714625152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050033.257554:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050033.257732:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625152 00000100:00100000:0.0:1789050033.257741:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625152 00000100:00100000:0.0:1789050033.257815:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789050033.257826:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714625152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050033.257858:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050033.257906:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714625152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.257912:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789050033.257986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcaa00 x1875954714625152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050033.258003:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714625152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050033.258443:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714625024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050033.258482:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050033.258773:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625024 00000100:00100000:0.0:1789050033.258780:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625024 00000100:00100000:0.0:1789050033.258831:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789050033.258839:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714625024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050033.258853:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050033.258891:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714625024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.258897:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789050033.258975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8e00 x1875954714625024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050033.258989:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714625024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789050033.259538:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789050033.259759:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050033.770569:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050033.770611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714625408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.770693:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050033.770769:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625408 00000100:00100000:2.0:1789050033.770777:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625408 00000100:00100000:2.0:1789050033.770825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789050033.770835:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714625408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.770891:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714625408:12345-0@lo:400:kworker.0 Request processed in 57us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050033.770898:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789050033.770956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714625408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.770995:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714625536:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771021:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050033.771076:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050033.771082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714625920:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050033.771145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714626048:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771168:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050033.771215:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050033.771221:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714626432:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771247:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050033.771275:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626432 00000100:00100000:2.0:1789050033.771280:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626432 00000100:00100000:2.0:1789050033.771318:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789050033.771325:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714626432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771360:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714626432:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050033.771377:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789050033.771394:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050033.771414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982448e00 x1875954714626432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050033.771425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714626432:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714626560:0@lo:400:kworker.0 00000100:00100000:2.0:1789050033.771479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.771683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625920 00000100:00100000:1.0:1789050033.771689:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625920 00000100:00100000:1.0:1789050033.771728:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626048 00000100:00100000:1.0:1789050033.771732:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626048 00000100:00100000:1.0:1789050033.771747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789050033.771754:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714625920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.771795:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714625920:12345-0@lo:400:kworker.0 Request processed in 41us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.771802:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789050033.771816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789050033.771821:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714626048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.771847:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714626048:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.771853:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789050033.771870:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714625664:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.771896:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.771913:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714626176:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.771971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.771986:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789050033.771992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714625280:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.772039:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714625792:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.772079:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714626304:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772099:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.772118:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625536 00000100:00100000:1.0:1789050033.772121:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625536 00000100:00100000:1.0:1789050033.772137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625792 00000100:00100000:1.0:1789050033.772139:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625792 00000100:00100000:1.0:1789050033.772151:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789050033.772157:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714625536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772190:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714625536:12345-0@lo:400:kworker.0 Request processed in 33us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.772196:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789050033.772208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050033.772214:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714625792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772243:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714625792:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.772249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050033.772265:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625664 00000100:00100000:1.0:1789050033.772269:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625664 00000100:00100000:1.0:1789050033.772282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626176 00000100:00100000:1.0:1789050033.772285:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626176 00000100:00100000:1.0:1789050033.772297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626304 00000100:00100000:1.0:1789050033.772305:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626304 00000100:00100000:1.0:1789050033.772321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789050033.772327:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714625664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772356:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714625664:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.772362:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789050033.772374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789050033.772379:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714626176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772404:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714626176:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.772410:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789050033.772420:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789050033.772426:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714626304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772465:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714626304:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.772471:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789050033.772500:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714625792:0@lo:400:kworker.0 00010000:00080000:1.0:1789050033.772510:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244bb80 x1875954714626304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050033.772529:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714626304:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772540:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714625664:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714626176:0@lo:400:kworker.0 00010000:00080000:1.0:1789050033.772578:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244b100 x1875954714626048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050033.772598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714626048:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772610:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714625920:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.772620:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714625536:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.772843:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714626688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050033.772875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050033.773068:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626560 00000100:00100000:0.0:1789050033.773073:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626560 00000100:00100000:0.0:1789050033.773117:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050033.773126:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714626560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.773167:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714626560:12345-0@lo:400:kworker.0 Request processed in 43us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.773173:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050033.773194:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714625280 00000100:00100000:0.0:1789050033.773198:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714625280 00000100:00100000:0.0:1789050033.773220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789050033.773226:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714625280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.773259:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714625280:12345-0@lo:400:kworker.0 Request processed in 33us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.773265:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789050033.773293:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626688 00000100:00100000:0.0:1789050033.773298:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626688 00000100:00100000:0.0:1789050033.773320:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789050033.773326:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714626688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050033.773346:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050033.773377:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714626688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.773382:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789050033.773463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709f80 x1875954714626688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050033.773478:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714626688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050033.773489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714625280:0@lo:400:kworker.0 00000100:00080000:2.0:1789050033.773927:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050033.773933:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050033.773956:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789050033.774087:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982448e00 x1875954714626560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050033.774098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714626560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.774159:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050033.774169:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714626816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050033.774207:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050033.774286:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626816 00000100:00100000:1.0:1789050033.774292:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626816 00000100:00100000:1.0:1789050033.774334:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050033.774341:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714626816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050033.774357:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050033.774398:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714626816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.774404:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789050033.774500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae797100 x1875954714626816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050033.774512:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714626816:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789050034.281151:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050034.633330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633645:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050034.633699:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070400 00000100:00100000:0.0:1789050034.634112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070144 00000100:00100000:0.0:1789050034.634131:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070144 00000100:00100000:0.0:1789050034.634186:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 299 00000100:00100000:0.0:1789050034.634196:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704070144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634282:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704070144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 88us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 299 00000100:00100000:0.0:1789050034.634323:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070656 00000100:00100000:0.0:1789050034.634327:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070656 00000100:00100000:0.0:1789050034.634355:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070272 00000100:00100000:0.0:1789050034.634358:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070272 00000100:00100000:0.0:1789050034.634370:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070528 00000100:00100000:0.0:1789050034.634372:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070528 00000100:00100000:0.0:1789050034.634386:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:0.0:1789050034.634393:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070656:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634423:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070656:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634429:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:0.0:1789050034.634440:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:0.0:1789050034.634446:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704070272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634468:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704070272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634473:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:0.0:1789050034.634485:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 131 00000100:00100000:0.0:1789050034.634491:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070528:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634525:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070528:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634537:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 131 00000100:00100000:0.0:1789050034.634560:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070912 00000100:00100000:0.0:1789050034.634564:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070912 00000100:00100000:0.0:1789050034.634589:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070784 00000100:00100000:0.0:1789050034.634593:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070784 00000100:00100000:0.0:1789050034.634626:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789050034.634633:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070912:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634659:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070912:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634666:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789050034.634677:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:0.0:1789050034.634683:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070784:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.634880:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2405:x1875954704070784:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 195us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.634887:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:3.0:1789050034.635501:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070400 00000100:00100000:3.0:1789050034.635555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:3.0:1789050034.635563:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704070400:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050034.635659:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704070400:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 97us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050034.635667:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00080000:2.0:1789050034.636987:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050034.636995:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050034.636998:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050034.637001:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1789050034.803860:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00100000:0.0:1789050034.804429:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00100000:2.0:1789050034.809722:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00100000:1.0:1789050034.819189:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00010000:00010000:0.0:1789050035.305160:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789050035.859322:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1789050036.329298:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714626944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050036.329372:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050036.329454:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714626944 00000100:00100000:3.0:1789050036.329462:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714626944 00000100:00100000:3.0:1789050036.329514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789050036.329523:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714626944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050036.329559:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050036.329604:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714626944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050036.329611:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789050036.329658:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714626944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050036.332287:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050036.841200:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050036.841224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714627072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050036.841296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050036.841584:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627072 00000100:00100000:3.0:1789050036.841592:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627072 00000100:00100000:3.0:1789050036.841742:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789050036.841755:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714627072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050036.841793:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050036.841858:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714627072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050036.841866:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789050036.841964:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714627072:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050037.353409:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050038.377150:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050038.377176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714627200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050038.377257:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.377323:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627200 00000100:00100000:0.0:1789050038.377330:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627200 00000100:00100000:0.0:1789050038.377387:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789050038.377397:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714627200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050038.377439:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050038.377485:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714627200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.377505:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789050038.377548:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8e00 x1875954714627200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050038.377567:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714627200:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789050038.377662:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050038.377682:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050038.377691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714627328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050038.377721:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050038.377749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627328 00000100:00100000:2.0:1789050038.377753:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627328 00000100:00100000:2.0:1789050038.377783:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050038.377790:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714627328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050038.377800:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050038.377830:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714627328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050038.377843:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789050038.377858:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789050038.377876:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982449c00 x1875954714627328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050038.377890:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714627328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050038.381259:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050038.889263:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050038.889288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714627456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050038.889378:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.889448:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627456 00000100:00100000:3.0:1789050038.889455:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627456 00000100:00100000:3.0:1789050038.889527:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050038.889538:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714627456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050038.889571:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050038.889631:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714627456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.889639:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789050038.889664:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789050038.889707:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae709500 x1875954714627456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050038.889727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714627456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050038.890888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714627584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050038.890990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050038.891091:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627584 00000100:00100000:1.0:1789050038.891099:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627584 00000100:00100000:1.0:1789050038.891152:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789050038.891172:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714627584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050038.891192:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050038.891234:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714627584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.891240:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789050038.891581:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789050038.891611:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae797100 x1875954714627584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050038.891642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714627584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050038.905238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714627968:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905314:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.905366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714628480:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905389:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.905406:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714628992:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905424:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.905445:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050038.905450:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714628096:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905498:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.905516:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714628608:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.905572:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627968 00000100:00100000:0.0:1789050038.905579:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627968 00000100:00100000:0.0:1789050038.905635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789050038.905644:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714627968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.905970:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714627968:12345-0@lo:400:kworker.0 Request processed in 326us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.905985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789050038.906008:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628480 00000100:00100000:0.0:1789050038.906012:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628480 00000100:00100000:0.0:1789050038.906043:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628992 00000100:00100000:0.0:1789050038.906047:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628992 00000100:00100000:0.0:1789050038.906060:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628096 00000100:00100000:0.0:1789050038.906063:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628096 00000100:00100000:0.0:1789050038.906078:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789050038.906084:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714628480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.906118:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714628480:12345-0@lo:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.906125:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789050038.906138:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789050038.906144:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714628992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.906173:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714628992:12345-0@lo:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.906179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789050038.906191:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789050038.906197:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714628096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.906237:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714628096:12345-0@lo:400:kworker.0 Request processed in 39us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.906243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789050038.906265:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628608 00000100:00100000:0.0:1789050038.906269:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628608 00000100:00100000:0.0:1789050038.906292:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789050038.906298:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714628608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.906337:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714628608:12345-0@lo:400:kworker.0 Request processed in 39us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.906344:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789050038.906378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714628096:0@lo:400:kworker.0 00010000:00080000:0.0:1789050038.906392:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a3100 x1875954714628608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050038.906401:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714628608:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.906411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714627968:0@lo:400:kworker.0 00010000:00080000:0.0:1789050038.906419:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a1f80 x1875954714628480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050038.906426:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714628480:0@lo:400:kworker.0 00010000:00080000:0.0:1789050038.906435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983495500 x1875954714628992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050038.906442:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714628992:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906597:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714627840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906673:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714628352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906704:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906726:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714628864:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906763:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789050038.906769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714627712:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906795:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906817:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714628224:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906841:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906857:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714628736:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.906877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.906904:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627840 00000100:00100000:3.0:1789050038.906909:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627840 00000100:00100000:3.0:1789050038.906929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628352 00000100:00100000:3.0:1789050038.906932:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628352 00000100:00100000:3.0:1789050038.906965:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628864 00000100:00100000:3.0:1789050038.906969:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628864 00000100:00100000:3.0:1789050038.906983:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789050038.906989:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714627840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.907028:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714627840:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.907034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789050038.907051:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789050038.907057:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714628352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.907082:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714628352:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.907094:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789050038.907106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789050038.907112:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714628864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.907141:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714628864:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.907148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789050038.907166:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628224 00000100:00100000:3.0:1789050038.907169:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628224 00000100:00100000:3.0:1789050038.907187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789050038.907194:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714628224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.907224:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714628224:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.907229:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789050038.908884:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050038.908896:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050038.908923:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714627712 00000100:00100000:3.0:1789050038.908933:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714627712 00000100:00100000:3.0:1789050038.909001:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789050038.909011:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714627712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909086:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714627712:12345-0@lo:400:kworker.0 Request processed in 76us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.909093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789050038.909130:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714628736 00000100:00100000:3.0:1789050038.909134:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714628736 00000100:00100000:3.0:1789050038.909163:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050038.909169:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714628736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909218:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714628736:12345-0@lo:400:kworker.0 Request processed in 49us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.909225:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050038.909272:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714627712:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714628224:0@lo:400:kworker.0 00010000:00080000:3.0:1789050038.909302:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a0e00 x1875954714628736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050038.909312:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714628736:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909324:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714627840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909333:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714628352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.909345:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714628864:0@lo:400:kworker.0 00010000:00010000:0.0:1789050039.401245:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050039.760269:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760373:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760415:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050039.760465:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071296 00000100:00100000:3.0:1789050039.760475:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071296 00000100:00100000:3.0:1789050039.760542:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071552 00000100:00100000:3.0:1789050039.760545:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071552 00000100:00100000:3.0:1789050039.760560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071168 00000100:00100000:3.0:1789050039.760562:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071168 00000100:00100000:3.0:1789050039.760591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071424 00000100:00100000:3.0:1789050039.760594:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071424 00000100:00100000:3.0:1789050039.760610:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:3.0:1789050039.760619:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704071296:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.760691:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704071296:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 73us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.760699:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:3.0:1789050039.760721:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:3.0:1789050039.760728:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071552:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.760755:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071552:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.760761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:3.0:1789050039.760773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789050039.760779:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704071168:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.760803:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704071168:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.760809:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789050039.760821:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789050039.760827:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071424:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.760849:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071424:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.760854:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789050039.760873:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071808 00000100:00100000:3.0:1789050039.760876:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071808 00000100:00100000:3.0:1789050039.760909:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071680 00000100:00100000:3.0:1789050039.760912:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071680 00000100:00100000:3.0:1789050039.760930:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:3.0:1789050039.760978:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071808:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.761004:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071808:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 68us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.761009:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:3.0:1789050039.761022:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:3.0:1789050039.761028:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071680:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050039.761051:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704071680:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.761056:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00080000:3.0:1789050039.761083:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050039.761087:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050039.761089:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050039.761091:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050039.761338:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071040 00000100:00100000:0.0:1789050039.761344:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071040 00000100:00100000:0.0:1789050039.761371:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 301 00000100:00100000:0.0:1789050039.761377:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704071040:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050039.761405:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704071040:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050039.761411:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 301 00010000:00010000:1.0:1789050040.437775:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050041.449059:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050041.449498:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050041.449520:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714629120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050041.449590:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050041.449987:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629120 00000100:00100000:3.0:1789050041.449996:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629120 00000100:00100000:3.0:1789050041.450042:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789050041.450051:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714629120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050041.450089:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050041.450528:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714629120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 477us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050041.450536:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789050041.450593:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714629120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050041.962734:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714629248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050041.962805:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050041.963313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629248 00000100:00100000:3.0:1789050041.963333:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629248 00000100:00100000:3.0:1789050041.963397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789050041.963406:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714629248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050041.963451:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050041.963516:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714629248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050041.963523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789050041.963666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714629248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050042.473176:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050043.497058:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050043.497188:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050043.497214:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714629376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050043.497300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050043.497704:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629376 00000100:00100000:3.0:1789050043.497715:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629376 00000100:00100000:3.0:1789050043.497789:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789050043.497802:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714629376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050043.497837:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789050043.498623:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050043.499015:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714629376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1212us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.499025:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789050043.500073:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98244bb80 x1875954714629376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050043.500101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98244bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714629376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050043.502898:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714629504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050043.503006:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050043.503130:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629504 00000100:00100000:2.0:1789050043.503141:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629504 00000100:00100000:2.0:1789050043.503220:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050043.503232:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714629504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050043.503259:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050043.503334:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714629504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.503342:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789050043.503447:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789050043.503995:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae797480 x1875954714629504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050043.504018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714629504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050044.009563:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714629888:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.009678:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.009746:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714630400:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.009778:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.009798:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714630912:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.009820:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.009849:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789050044.009855:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714629760:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.009892:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.009910:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714630272:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.009930:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.009974:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714630784:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.010217:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.010257:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629888 00000100:00100000:0.0:1789050044.010266:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629888 00000100:00100000:0.0:1789050044.010323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789050044.010332:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714629888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.010395:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714629888:12345-0@lo:400:kworker.0 Request processed in 64us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.010402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789050044.010428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630400 00000100:00100000:0.0:1789050044.010431:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630400 00000100:00100000:2.0:1789050044.011471:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714629632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011583:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714630144:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011629:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714630656:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011654:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011674:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714631168:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011695:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011719:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789050044.011726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714630016:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714630528:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714631040:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.011818:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.011857:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630912 00000100:00100000:2.0:1789050044.011865:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630912 00000100:00100000:0.0:1789050044.021149:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629760 00000100:00100000:0.0:1789050044.021170:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629760 00000100:00100000:0.0:1789050044.021202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630272 00000100:00100000:0.0:1789050044.021205:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630272 00000100:00100000:2.0:1789050044.021425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714631296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050044.021528:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.022342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714629632 00000100:00100000:2.0:1789050044.022352:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714629632 00000100:00100000:2.0:1789050044.022528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789050044.022539:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714629632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.022983:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714629632:12345-0@lo:400:kworker.0 Request processed in 445us (11443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.022992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789050044.023035:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630656 00000100:00100000:2.0:1789050044.023039:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630656 00000100:00100000:2.0:1789050044.023436:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631168 00000100:00100000:2.0:1789050044.023441:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631168 00000100:00100000:2.0:1789050044.023475:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630528 00000100:00100000:2.0:1789050044.023479:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630528 00000100:00100000:2.0:1789050044.023490:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631040 00000100:00100000:2.0:1789050044.023492:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631040 00000100:00100000:2.0:1789050044.023508:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789050044.023516:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714630656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.023570:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714630656:12345-0@lo:400:kworker.0 Request processed in 54us (11915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.023577:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789050044.023588:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050044.023594:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714631168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.024352:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714631168:12345-0@lo:400:kworker.0 Request processed in 754us (12651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.024512:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050044.024534:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050044.024544:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714630528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.024597:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714630528:12345-0@lo:400:kworker.0 Request processed in 56us (12817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.024612:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050044.024904:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050044.024921:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714631040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.024975:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714631040:12345-0@lo:400:kworker.0 Request processed in 56us (13155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.024981:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050044.025019:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631296 00000100:00100000:2.0:1789050044.025027:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631296 00000100:00100000:2.0:1789050044.025272:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789050044.025280:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714631296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050044.025306:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050044.026173:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714631296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 891us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.026183:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1789050044.026241:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832de300 x1875954714631296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.026267:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714631296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050044.026305:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630144 00000100:00100000:2.0:1789050044.026310:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630144 00000100:00100000:2.0:1789050044.026336:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789050044.026344:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714630144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.026507:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714630144:12345-0@lo:400:kworker.0 Request processed in 163us (14896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.026514:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1789050044.026544:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983497100 x1875954714630528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.026566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714630528:0@lo:400:kworker.0 00010000:00080000:2.0:1789050044.026596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983497800 x1875954714631040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.026612:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714631040:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.026925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714629632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.026960:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714630144:0@lo:400:kworker.0 00010000:00080000:2.0:1789050044.026975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983494000 x1875954714630656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.026985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714630656:0@lo:400:kworker.0 00010000:00080000:2.0:1789050044.026995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983496d80 x1875954714631168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.027004:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714631168:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.027067:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630784 00000100:00100000:2.0:1789050044.027072:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630784 00000100:00100000:2.0:1789050044.027091:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714630016 00000100:00100000:2.0:1789050044.027093:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714630016 00000100:00100000:2.0:1789050044.027106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789050044.027113:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714630400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.027152:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714630400:12345-0@lo:400:kworker.0 Request processed in 41us (17374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.027158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789050044.027170:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789050044.027177:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714629760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.027203:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714629760:12345-0@lo:400:kworker.0 Request processed in 27us (17311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.027215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789050044.027226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789050044.027232:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714630912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.027262:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714630912:12345-0@lo:400:kworker.0 Request processed in 30us (17441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.027267:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789050044.027278:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789050044.027284:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714630784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.027309:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714630784:12345-0@lo:400:kworker.0 Request processed in 25us (17092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.027314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789050044.027323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789050044.027328:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714630016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.028157:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714630016:12345-0@lo:400:kworker.0 Request processed in 822us (16401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.028178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789050044.028221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714630016:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.028353:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050044.028375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714631424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050044.028420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.029069:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714629760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.029084:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714630784:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.029096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714629888:0@lo:400:kworker.0 00010000:00080000:2.0:1789050044.029126:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983497480 x1875954714630400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.029137:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714630400:0@lo:400:kworker.0 00010000:00080000:2.0:1789050044.029148:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983494380 x1875954714630912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050044.029157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714630912:0@lo:400:kworker.0 00000100:00100000:3.0:1789050044.029276:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631424 00000100:00100000:3.0:1789050044.029285:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631424 00000100:00100000:3.0:1789050044.029335:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789050044.029345:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714631424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050044.029369:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050044.029431:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714631424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.029439:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789050044.029568:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae797480 x1875954714631424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050044.029585:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714631424:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789050044.032266:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050044.032277:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050044.032288:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050044.032372:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789050044.032390:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714630272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.032509:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714630272:12345-0@lo:400:kworker.0 Request processed in 127us (22576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.032516:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789050044.032573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714630272:0@lo:400:kworker.0 00010000:00010000:1.0:1789050044.521081:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050044.875502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050044.875545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050044.875577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050044.875613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050044.875687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050044.875780:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072192 00000100:00100000:2.0:1789050044.875790:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072192 00000100:00100000:2.0:1789050044.875868:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072064 00000100:00100000:2.0:1789050044.875872:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072064 00000100:00100000:2.0:1789050044.875889:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072320 00000100:00100000:2.0:1789050044.875891:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072320 00000100:00100000:2.0:1789050044.875909:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:2.0:1789050044.875920:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704072192:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050044.876033:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704072192:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 114us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.876041:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:2.0:1789050044.876059:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:2.0:1789050044.876066:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704072064:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050044.876093:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704072064:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.876100:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:2.0:1789050044.876123:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:2.0:1789050044.876131:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704072320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050044.876176:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704072320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 47us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.876182:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:2.0:1789050044.876201:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072576 00000100:00100000:2.0:1789050044.876205:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072576 00000100:00100000:2.0:1789050044.876231:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:2.0:1789050044.876238:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704072576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050044.876262:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704072576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.876269:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00080000:1.0:1789050044.877264:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050044.877270:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050044.877272:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050044.877535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071936 00000100:00100000:3.0:1789050044.877553:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071936 00000100:00100000:3.0:1789050044.877602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 303 00000100:00100000:3.0:1789050044.877610:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704071936:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050044.877673:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704071936:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 56us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.877681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 303 00000100:00100000:1.0:1789050044.887318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050044.887366:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050044.887527:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072448 00000100:00100000:2.0:1789050044.887537:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072448 00000100:00100000:2.0:1789050044.887608:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:2.0:1789050044.887617:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704072448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050044.887728:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072704 00000100:00100000:3.0:1789050044.887741:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072704 00000100:00100000:2.0:1789050044.887756:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704072448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 138us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.887766:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:3.0:1789050044.887816:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:3.0:1789050044.887829:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704072704:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050044.887920:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704072704:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 94us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.887972:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00080000:1.0:1789050044.888276:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050044.888281:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789050045.550043:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789050045.836913:0:12502:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050045.840311:0:12502:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789050046.574054:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050046.574683:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714631552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050046.574757:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050046.575169:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631552 00000100:00100000:1.0:1789050046.575178:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631552 00000100:00100000:1.0:1789050046.575288:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789050046.575299:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714631552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050046.575591:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050046.575657:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714631552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 359us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050046.575665:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789050046.575763:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714631552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050047.081983:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714631680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050047.082062:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050047.082175:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631680 00000100:00100000:2.0:1789050047.082183:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631680 00000100:00100000:2.0:1789050047.082242:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050047.082266:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714631680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050047.082305:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050047.082356:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714631680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050047.082363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050047.082406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714631680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050047.593065:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789050048.116317:0:12599:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050048.116558:0:12599:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789050048.617209:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714631808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050048.617293:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050048.617363:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050048.617371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714631936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050048.617393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050048.617437:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631808 00000100:00100000:3.0:1789050048.617445:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631808 00000100:00100000:3.0:1789050048.617504:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714631936 00000100:00100000:3.0:1789050048.617506:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714631936 00000100:00100000:3.0:1789050048.617524:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789050048.617533:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714631808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050048.617634:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050048.617696:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714631808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050048.617703:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789050048.617974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789050048.617984:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714631936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050048.617996:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050048.618026:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714631936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050048.618032:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789050048.618052:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789050048.618109:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1789050048.618318:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c3b80 x1875954714631936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050048.618337:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714631936:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789050048.618347:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9180 x1875954714631808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050048.618357:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714631808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050049.130551:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050049.130575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714632064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050049.130647:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050049.130717:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632064 00000100:00100000:0.0:1789050049.130724:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632064 00000100:00100000:0.0:1789050049.130971:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789050049.130981:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714632064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050049.131012:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050049.131056:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714632064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.131063:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789050049.131084:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789050049.131113:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832df480 x1875954714632064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050049.131131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714632064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050049.131759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714632320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.131799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.131824:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714632832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132073:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.132097:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714633344:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.132141:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789050049.132147:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714632448:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.132186:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714632960:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132205:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.132220:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714633472:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.132261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632320 00000100:00100000:2.0:1789050049.132266:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632320 00000100:00100000:2.0:1789050049.132294:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632832 00000100:00100000:2.0:1789050049.132296:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632832 00000100:00100000:2.0:1789050049.132327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633344 00000100:00100000:2.0:1789050049.132329:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633344 00000100:00100000:2.0:1789050049.132338:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632960 00000100:00100000:2.0:1789050049.132340:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632960 00000100:00100000:2.0:1789050049.132349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633472 00000100:00100000:2.0:1789050049.132351:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633472 00000100:00100000:2.0:1789050049.132365:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789050049.132371:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714632320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132409:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714632320:12345-0@lo:400:kworker.0 Request processed in 39us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132428:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789050049.132442:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789050049.132447:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714632832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132471:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714632832:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789050049.132486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789050049.132491:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714633344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132510:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714633344:12345-0@lo:400:kworker.0 Request processed in 20us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789050049.132523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789050049.132527:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714632960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132667:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714632960:12345-0@lo:400:kworker.0 Request processed in 138us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132673:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789050049.132684:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789050049.132697:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714633472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132724:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714633472:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789050049.132774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632448 00000100:00100000:2.0:1789050049.132778:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632448 00000100:00100000:2.0:1789050049.132803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050049.132809:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714632448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132851:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714632448:12345-0@lo:400:kworker.0 Request processed in 33us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.132858:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789050049.132878:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050049.132882:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050049.132904:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714632448:0@lo:400:kworker.0 00010000:00080000:2.0:1789050049.132916:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9180 x1875954714632960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050049.132925:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714632960:0@lo:400:kworker.0 00010000:00080000:2.0:1789050049.132953:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983494380 x1875954714633472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050049.132962:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714633472:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132972:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714632320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132980:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714632832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.132987:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714633344:0@lo:400:kworker.0 00000100:00100000:0.0:1789050049.135797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714632192:0@lo:400:kworker.0 00000100:00100000:0.0:1789050049.135897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050049.135971:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714632704:0@lo:400:kworker.0 00000100:00100000:0.0:1789050049.135997:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050049.136020:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714633216:0@lo:400:kworker.0 00000100:00100000:0.0:1789050049.136043:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050049.136059:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714633728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050049.136081:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.136279:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714632576:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.136312:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.136332:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714633088:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.136350:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.136365:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714633600:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.136382:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.136431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632576 00000100:00100000:1.0:1789050049.136439:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632576 00000100:00100000:1.0:1789050049.136484:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789050049.136493:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714632576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.136686:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632192 00000100:00100000:2.0:1789050049.136691:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632192 00000100:00100000:2.0:1789050049.136722:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789050049.136728:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714632192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.136775:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714632192:12345-0@lo:400:kworker.0 Request processed in 47us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.136782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789050049.136813:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633216 00000100:00100000:2.0:1789050049.136816:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633216 00000100:00100000:2.0:1789050049.136837:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633088 00000100:00100000:2.0:1789050049.136839:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633088 00000100:00100000:2.0:1789050049.136864:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633600 00000100:00100000:2.0:1789050049.136866:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633600 00000100:00100000:2.0:1789050049.136888:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050049.136895:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714633216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.136924:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714633216:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.136930:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050049.136956:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050049.136963:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714633088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.136994:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714633088:12345-0@lo:400:kworker.0 Request processed in 32us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.137000:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050049.137009:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789050049.137014:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714633600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.137038:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714633600:12345-0@lo:400:kworker.0 Request processed in 25us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.137051:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789050049.137073:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050049.137229:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714632576:12345-0@lo:400:kworker.0 Request processed in 737us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050049.137235:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789050049.137277:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714632576:0@lo:400:kworker.0 00010000:00080000:1.0:1789050049.137290:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9c00 x1875954714633088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050049.137300:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714633088:0@lo:400:kworker.0 00010000:00080000:1.0:1789050049.137309:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983497480 x1875954714633600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050049.137317:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714633600:0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.137669:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633728 00000100:00100000:3.0:1789050049.137674:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633728 00000100:00100000:0.0:1789050049.137674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714632192:0@lo:400:kworker.0 00010000:00080000:0.0:1789050049.137684:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dca680 x1875954714633216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050049.137692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714633216:0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.137712:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050049.137715:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714632704 00000100:00100000:0.0:1789050049.137717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714632704 00000100:00100000:3.0:1789050049.137719:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714633728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050049.137735:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050049.137756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789050049.137763:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714632704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.137787:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714633728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050049.137794:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050049.137795:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714632704:12345-0@lo:400:kworker.0 Request processed in 33us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.137800:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789050049.137822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714632704:0@lo:400:kworker.0 00010000:00080000:0.0:1789050049.137831:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570bb80 x1875954714633728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050049.137854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714633728:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789050049.644349:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050049.993615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993722:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050049.993852:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073088 00000100:00100000:0.0:1789050049.993861:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073088 00000100:00100000:0.0:1789050049.993926:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073344 00000100:00100000:0.0:1789050049.993930:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073344 00000100:00100000:0.0:1789050049.993965:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072960 00000100:00100000:0.0:1789050049.993968:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072960 00000100:00100000:0.0:1789050049.993980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073216 00000100:00100000:0.0:1789050049.993982:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073216 00000100:00100000:0.0:1789050049.993999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:0.0:1789050049.994008:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704073088:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050049.994086:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704073088:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.994093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:0.0:1789050049.994109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:0.0:1789050049.994115:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704073344:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050049.994153:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704073344:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.994159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:0.0:1789050049.994170:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:0.0:1789050049.994177:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704072960:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050049.994213:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704072960:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 37us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.994219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:0.0:1789050049.994232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:0.0:1789050049.994238:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704073216:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050049.994259:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704073216:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.994265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:0.0:1789050049.994291:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073472 00000100:00100000:0.0:1789050049.994295:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073472 00000100:00100000:0.0:1789050049.994329:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073600 00000100:00100000:0.0:1789050049.994332:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073600 00000100:00100000:0.0:1789050049.994355:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789050049.994361:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2402:x1875954704073472:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:0.0:1789050049.994383:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df574b0 00000100:00080000:0.0:1789050049.994392:0:8629:0:(import.c:65:import_set_state_nolock()) ffff8ba98274d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789050049.994446:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000001:00000004:0.0:1789050049.994448:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789050049.994454:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2402:x1875954704073600:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:2.0:1789050049.994467:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df574b7 00000100:00080000:2.0:1789050049.994472:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ba9834d1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050049.994501:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789050049.994565:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+2:2402:x1875954704073472:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 203us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050049.994571:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00080000:0.0:1789050049.994591:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050049.994595:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050049.994598:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050049.994599:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789050049.994719:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050049.995550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072832 00000100:00100000:3.0:1789050049.995558:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072832 00000100:00100000:3.0:1789050049.995617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 305 00000100:00100000:3.0:1789050049.995626:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704072832:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050049.995682:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704072832:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 58us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050049.995688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 305 00000100:00100000:2.0:1789050049.997211:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+2:2402:x1875954704073600:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 2751us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.997223:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00010000:00010000:2.0:1789050049.997254:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789050050.131010:0:12698:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050050.131304:0:12698:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789050050.672719:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050051.692306:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050051.692312:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714633856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050051.692408:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050051.692659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633856 00000100:00100000:1.0:1789050051.692666:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633856 00000100:00100000:1.0:1789050051.692717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789050051.692728:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714633856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050051.692765:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050051.692824:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714633856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050051.692830:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789050051.693092:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714633856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050052.203917:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714633984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050052.204012:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050052.204723:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714633984 00000100:00100000:1.0:1789050052.204733:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714633984 00000100:00100000:1.0:1789050052.204823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789050052.204833:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714633984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050052.204876:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789050052.204977:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714633984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050052.204995:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789050052.205228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714633984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050052.738925:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789050053.174897:0:12795:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789050053.175105:0:12795:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789050053.737642:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050053.737669:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714634112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050053.737740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050053.737860:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634112 00000100:00100000:1.0:1789050053.737869:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634112 00000100:00100000:1.0:1789050053.737931:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789050053.737973:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714634112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050053.738004:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050053.738050:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714634112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050053.738057:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1789050053.738099:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c2a00 x1875954714634112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050053.738115:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714634112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050053.738185:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050053.738461:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714634240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050053.738490:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050053.738568:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634240 00000100:00100000:0.0:1789050053.738573:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634240 00000100:00100000:0.0:1789050053.738615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789050053.738622:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714634240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050053.738632:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050053.738662:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714634240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050053.738668:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1789050053.738816:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983495c00 x1875954714634240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050053.738829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714634240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789050053.738879:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789050053.807447:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050054.250224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714634624:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250297:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250346:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714635136:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250409:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714635648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789050054.250472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714634752:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250494:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250511:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714635264:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714635776:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250603:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.250639:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634624 00000100:00100000:2.0:1789050054.250646:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634624 00000100:00100000:2.0:1789050054.250691:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789050054.250700:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714634624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250755:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714634624:12345-0@lo:400:kworker.0 Request processed in 56us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.250762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789050054.250785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635136 00000100:00100000:2.0:1789050054.250789:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635136 00000100:00100000:2.0:1789050054.250830:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635648 00000100:00100000:2.0:1789050054.250833:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635648 00000100:00100000:2.0:1789050054.250846:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634752 00000100:00100000:2.0:1789050054.250848:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634752 00000100:00100000:2.0:1789050054.250859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789050054.250865:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714635136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250895:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714635136:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.250901:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789050054.250911:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789050054.250917:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714635648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.250977:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714635648:12345-0@lo:400:kworker.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.250983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789050054.250995:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789050054.251001:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714634752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.251016:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714634496:0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.251025:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714634752:12345-0@lo:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.251030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789050054.251044:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050054.251061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714635008:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.251079:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.251367:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714634368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.251463:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714634880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251480:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.251493:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714635392:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.251528:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714635904:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.251631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634368 00000100:00100000:3.0:1789050054.251636:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634368 00000100:00100000:3.0:1789050054.251664:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789050054.251672:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714634368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251702:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714634368:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.251709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789050054.251739:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635264 00000100:00100000:3.0:1789050054.251743:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635264 00000100:00100000:3.0:1789050054.251760:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635776 00000100:00100000:3.0:1789050054.251762:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635776 00000100:00100000:3.0:1789050054.251775:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635392 00000100:00100000:3.0:1789050054.251778:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635392 00000100:00100000:3.0:1789050054.251788:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635904 00000100:00100000:3.0:1789050054.251791:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635904 00000100:00100000:3.0:1789050054.251816:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050054.251822:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714635264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251863:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714635264:12345-0@lo:400:kworker.0 Request processed in 41us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.251870:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050054.251882:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789050054.251888:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714635776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251914:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714635776:12345-0@lo:400:kworker.0 Request processed in 26us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.251919:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789050054.251930:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050054.251954:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714635392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.251981:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714635392:12345-0@lo:400:kworker.0 Request processed in 46us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.251986:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050054.251998:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789050054.252003:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714635904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.252028:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714635904:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.252034:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789050054.252058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634880 00000100:00100000:3.0:1789050054.252061:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634880 00000100:00100000:3.0:1789050054.252079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050054.252084:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714634880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.252112:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714634880:12345-0@lo:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.252117:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050054.252155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714634368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.252167:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714634880:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9c00 x1875954714635392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714635392:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252194:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9180 x1875954714635904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252202:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714635904:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.252219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050054.252225:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714636032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050054.252248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050054.252275:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636032 00000100:00100000:3.0:1789050054.252278:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636032 00000100:00100000:3.0:1789050054.252303:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789050054.252309:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714636032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050054.252330:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050054.252362:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714636032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.252368:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1789050054.252407:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832de680 x1875954714636032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252421:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714636032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050054.252478:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714634752:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252499:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc8700 x1875954714635264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252507:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714635264:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252516:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9500 x1875954714635776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252522:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714635776:0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.252531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714634624:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252540:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dca680 x1875954714635136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714635136:0@lo:400:kworker.0 00010000:00080000:3.0:1789050054.252557:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcad80 x1875954714635648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050054.252563:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714635648:0@lo:400:kworker.0 00000100:00080000:3.0:1789050054.252593:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050054.252598:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050054.253735:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714635520:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.253773:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.256438:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714634496 00000100:00100000:2.0:1789050054.256449:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714634496 00000100:00100000:2.0:1789050054.256497:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635008 00000100:00100000:2.0:1789050054.256501:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635008 00000100:00100000:2.0:1789050054.256559:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789050054.256569:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714634496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.256651:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714634496:12345-0@lo:400:kworker.0 Request processed in 84us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.256659:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789050054.256676:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789050054.256682:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714635008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050054.256710:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714635008:12345-0@lo:400:kworker.0 Request processed in 28us (5629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.256716:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789050054.261970:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714634496:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.261989:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714635008:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.262033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714635520 00000100:00100000:0.0:1789050054.262045:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714635520 00000100:00100000:0.0:1789050054.262102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789050054.262118:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714635520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.262206:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714635520:12345-0@lo:400:kworker.0 Request processed in 92us (8431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050054.262213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789050054.262476:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714635520:0@lo:400:kworker.0 00000100:00080000:3.0:1789050054.262558:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050054.262646:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714636160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050054.262690:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.265121:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636160 00000100:00100000:2.0:1789050054.265135:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636160 00000100:00100000:2.0:1789050054.267706:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789050054.267737:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714636160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050054.267791:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050054.267897:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714636160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 177us (5207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.267904:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789050054.267998:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832c3800 x1875954714636160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050054.268022:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714636160:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789050054.830114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050055.127934:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050055.128009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050055.128044:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050055.128062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050055.128097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050055.128128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073984 00000100:00100000:0.0:1789050055.128138:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073984 00000100:00100000:0.0:1789050055.128188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074240 00000100:00100000:0.0:1789050055.128191:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074240 00000100:00100000:0.0:1789050055.128206:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073856 00000100:00100000:0.0:1789050055.128208:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073856 00000100:00100000:0.0:1789050055.128218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074112 00000100:00100000:0.0:1789050055.128221:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074112 00000100:00100000:0.0:1789050055.128234:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:0.0:1789050055.128242:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704073984:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050055.128308:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704073984:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050055.128315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:0.0:1789050055.128329:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:0.0:1789050055.128345:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704074240:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050055.128367:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704074240:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050055.128385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:0.0:1789050055.128397:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:0.0:1789050055.128404:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704073856:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050055.128431:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704073856:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050055.128437:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:3.0:1789050055.128449:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:3.0:1789050055.128460:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704074112:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050055.128487:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704074112:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050055.128498:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073728 00000100:00100000:2.0:1789050055.128502:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073728 00000100:00100000:2.0:1789050055.131047:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 307 00000100:00100000:2.0:1789050055.131060:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704073728:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050055.131124:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704073728:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 67us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050055.131132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 307 00000100:00080000:2.0:1789050055.132308:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050055.132315:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050055.137061:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 172 00000001:00100000:0.0:1789050055.789862:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000020:00000080:0.0:1789050055.789875:0:8427:0:(genops.c:885:class_export_put()) final put ffff8ba98274f000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000020:00000080:1.0:1789050055.789977:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274f000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 for lustre-OST0000 00000020:00000080:1.0:1789050055.790055:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274d800 for lustre-OST0000 00000001:00100000:0.0:1789050055.813021:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000020:00000080:0.0:1789050055.813033:0:9512:0:(genops.c:885:class_export_put()) final put ffff8ba9834d5000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000020:00000080:1.0:1789050055.813109:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba9834d5000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 for lustre-OST0001 00000020:00000080:1.0:1789050055.813181:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba9834d1800 for lustre-OST0001 00010000:00010000:2.0:1789050055.859578:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789050056.463321:0:12893:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050056.463583:0:12893:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789050056.811480:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050056.811506:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714636288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050056.811581:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050056.818184:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636288 00000100:00100000:1.0:1789050056.818198:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636288 00000100:00100000:1.0:1789050056.818251:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789050056.818261:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714636288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050056.818327:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050056.818424:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714636288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (6842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050056.818431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789050056.818490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714636288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050056.873478:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050057.322242:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050057.322275:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714636416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050057.322345:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050057.322433:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636416 00000100:00100000:3.0:1789050057.322441:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636416 00000100:00100000:3.0:1789050057.322487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789050057.322496:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714636416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050057.322533:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050057.322585:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714636416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050057.322592:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789050057.322654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714636416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789050057.897778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050058.859370:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050058.859396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714636672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050058.859463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050058.859592:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714636544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050058.859623:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050058.859657:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636672 00000100:00100000:1.0:1789050058.859664:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636672 00000100:00100000:1.0:1789050058.859707:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636544 00000100:00100000:1.0:1789050058.859710:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636544 00000100:00100000:1.0:1789050058.859726:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789050058.859733:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714636672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050058.859763:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050058.859820:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714636672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050058.859827:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789050058.859843:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789050058.859849:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714636544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050058.859859:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050058.859885:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714636544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050058.859891:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789050058.859921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832f7100 x1875954714636544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050058.859989:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714636544:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789050058.860019:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982711500 x1875954714636672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050058.860030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714636672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789050058.860232:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789050058.925926:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050059.369356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714636800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050059.369433:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.369676:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636800 00000100:00100000:3.0:1789050059.369684:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636800 00000100:00100000:3.0:1789050059.369753:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789050059.369763:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714636800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050059.369806:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050059.369850:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714636800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.369857:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789050059.370055:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050059.370238:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050059.370249:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714636928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050059.370282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.370309:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714637056:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.370354:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.370393:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714636928 00000100:00100000:3.0:1789050059.370398:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714636928 00000100:00100000:3.0:1789050059.370431:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789050059.370439:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714636928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050059.370452:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789050059.370515:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050059.370525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714637184:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.370558:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.370578:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714637696:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.370598:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.370614:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050059.370628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714637312:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.370645:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714636928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 205us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.370653:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789050059.370677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637056 00000100:00100000:3.0:1789050059.370680:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637056 00000100:00100000:3.0:1789050059.370705:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789050059.370712:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714637056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.370787:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637184 00000100:00100000:1.0:1789050059.370793:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637184 00000100:00100000:1.0:1789050059.370820:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637696 00000100:00100000:1.0:1789050059.370822:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637696 00000100:00100000:1.0:1789050059.370844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789050059.370859:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714637184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050059.370921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714637440:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.371650:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714637056:12345-0@lo:400:kworker.0 Request processed in 936us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.371659:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789050059.371701:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789050059.371829:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714637696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.371881:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714637696:12345-0@lo:400:kworker.0 Request processed in 174us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.371889:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1789050059.371973:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050059.372003:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714637568:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.372035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.372059:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714638080:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.372093:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.372124:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714637056:0@lo:400:kworker.0 00010000:00080000:3.0:1789050059.372140:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dcad80 x1875954714636928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050059.372158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714636928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050059.372189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637568 00000100:00100000:3.0:1789050059.372194:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637568 00000100:00100000:3.0:1789050059.372225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789050059.372232:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714637568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.372269:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714637568:12345-0@lo:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.372275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789050059.372294:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638080 00000100:00100000:3.0:1789050059.372297:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638080 00000100:00100000:3.0:1789050059.372319:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789050059.372325:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714638080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.372366:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714638080:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.372371:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1789050059.372385:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050059.372400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714637568:0@lo:400:kworker.0 00010000:00080000:3.0:1789050059.372409:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a0000 x1875954714638080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050059.372424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714638080:0@lo:400:kworker.0 00010000:00080000:3.0:1789050059.372467:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc8380 x1875954714636800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050059.372481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714636800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050059.376894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.377013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714637952:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.377044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.378415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050059.378464:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714637184:12345-0@lo:400:kworker.0 Request processed in 7608us (7899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.378471:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714637824:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.378479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789050059.378524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637312 00000100:00100000:0.0:1789050059.378532:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637312 00000100:00100000:0.0:1789050059.378578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789050059.378587:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714637312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.378643:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714637312:12345-0@lo:400:kworker.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.378650:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789050059.391877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637440 00000100:00100000:1.0:1789050059.391889:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637952 00000100:00100000:0.0:1789050059.391895:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637440 00000100:00100000:1.0:1789050059.391898:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637952 00000100:00100000:0.0:1789050059.392321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789050059.392333:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714637440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.392577:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714637440:12345-0@lo:400:kworker.0 Request processed in 247us (15690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.392586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789050059.392603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789050059.392611:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714637952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.392645:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714637952:12345-0@lo:400:kworker.0 Request processed in 35us (15599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.392651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789050059.398661:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714637952:0@lo:400:kworker.0 00000100:00100000:3.0:1789050059.398707:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714637440:0@lo:400:kworker.0 00000100:00080000:3.0:1789050059.398731:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050059.398995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050059.399035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714637184:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.399046:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714637696:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.399062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714637312:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.399079:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714637824 00000100:00100000:1.0:1789050059.399085:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714637824 00000100:00100000:1.0:1789050059.399137:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789050059.399159:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714637824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.399657:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714637824:12345-0@lo:400:kworker.0 Request processed in 496us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.399666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:1.0:1789050059.399698:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9836a2300 x1875954714637824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050059.399709:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714637824:0@lo:400:kworker.0 00000100:00080000:1.0:1789050059.399739:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789050059.952047:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050060.231541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050060.231587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050060.231616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050060.231636:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050060.231675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050060.231711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074624 00000100:00100000:2.0:1789050060.231725:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074624 00000100:00100000:2.0:1789050060.231808:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074880 00000100:00100000:2.0:1789050060.231811:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074880 00000100:00100000:2.0:1789050060.231829:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074496 00000100:00100000:2.0:1789050060.231852:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074496 00000100:00100000:2.0:1789050060.231869:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074752 00000100:00100000:2.0:1789050060.231872:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074752 00000100:00100000:2.0:1789050060.231890:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:2.0:1789050060.231902:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704074624:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050060.232035:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704074624:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 134us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.232043:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:2.0:1789050060.232063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:2.0:1789050060.232071:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704074880:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050060.232096:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704074880:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.232102:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:2.0:1789050060.232124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:2.0:1789050060.232131:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704074496:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050060.232156:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704074496:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.232162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:2.0:1789050060.232174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00100000:2.0:1789050060.232182:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704074752:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050060.232204:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704074752:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.232209:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00080000:2.0:1789050060.232231:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050060.232235:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050060.233626:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074368 00000100:00100000:3.0:1789050060.233642:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074368 00000100:00100000:3.0:1789050060.233721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 309 00000100:00100000:3.0:1789050060.233731:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704074368:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050060.234400:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704074368:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 664us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.234412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 309 00000001:02000400:2.0:1789050060.587325:0:13037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789050060.969302:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050061.946386:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714638208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050061.946464:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050061.946607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638208 00000100:00100000:1.0:1789050061.946615:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638208 00000100:00100000:1.0:1789050061.946684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789050061.946693:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714638208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050061.946732:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050061.947320:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714638208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 626us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.947339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050061.947464:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714638208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050061.999194:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050062.445879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714638336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050062.445978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050062.446366:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638336 00000100:00100000:2.0:1789050062.446375:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638336 00000100:00100000:2.0:1789050062.446433:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789050062.446440:0:6523:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789050062.446443:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714638336:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050062.446450:0:6523:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1789050062.446480:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050062.446547:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714638336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.446554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789050062.446650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714638336:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050063.017263:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050063.979099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714638464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050063.979167:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050063.979249:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638464 00000100:00100000:3.0:1789050063.979256:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638464 00000100:00100000:3.0:1789050063.980266:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714638592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789050063.980270:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050063.980371:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789050063.980384:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714638464:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050063.980397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789050063.980414:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050063.980441:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638592 00000100:00100000:3.0:1789050063.980446:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638592 00000100:00100000:0.0:1789050063.980473:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714638464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050063.980476:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789050063.980480:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789050063.980482:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714638592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050063.980492:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789050063.980529:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789050063.980559:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dc9c00 x1875954714638464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050063.980578:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714638464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050063.980641:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714638592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (243us total) trans 0 rc 0/0 00010000:00080000:0.0:1789050063.980641:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98227c380 x1875954714638592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050063.980648:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789050063.980653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714638592:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050064.041318:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789050064.142602:0:13186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff47156860 20000000:00000080:0.0:1789050064.142620:0:13186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baaae6ac800 uarg=0000000000000000 20000000:01000000:0.0:1789050064.146587:0:13186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789050064.146593:0:13186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789050064.146597:0:13186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789050064.147069:0:13187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789050064.147206:0:13186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789050064.153145:0:13186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789050064.153258:0:13186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153277:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153286:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153293:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153330:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153340:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153348:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153355:0:13186:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153397:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153414:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 12 pid: 6510 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.153430:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638720:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050064.153829:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153839:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.153849:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638848:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050064.153882:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.153900:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 23 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.153909:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638976:0@lo:104: 00000100:00100000:0.0:1789050064.155219:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050064.155330:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.155343:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 23 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.155354:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639104:0@lo:104: 00000100:00100000:0.0:1789050064.155385:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050064.155492:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.155500:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.155509:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639232:0@lo:104: 00000100:00100000:0.0:1789050064.155531:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050064.155613:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714638976 00000100:00100000:1.0:1789050064.155621:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714638976 00000100:00100000:1.0:1789050064.155680:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639104 00000100:00100000:1.0:1789050064.155683:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639104 00000100:00100000:1.0:1789050064.155697:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050064.155705:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:13186:x1875954714638976:12345-0@lo:104: 00010000:00010000:1.0:1789050064.155730:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.155780:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050064.155787:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:13186:x1875954714638976:12345-0@lo:104: Request processed in 83us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.155793:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050064.155810:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789050064.155816:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:13186:x1875954714639104:12345-0@lo:104: 00010000:00010000:1.0:1789050064.155824:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.155858:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789050064.155863:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:13186:x1875954714639104:12345-0@lo:104: Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.155869:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789050064.155884:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050064.155889:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.155896:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a4a00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050064.155900:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.155909:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050064.155917:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050064.155928:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050064.155975:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.155982:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050064.156003:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156010:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4a00/0x3b8ec5973df57478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5747f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156022:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050064.156025:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156029:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a4e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050064.156032:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156039:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050064.156045:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050064.156050:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050064.156060:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156065:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050064.156077:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156083:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4e00/0x3b8ec5973df5746a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57471 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.156090:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050064.156092:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050064.156093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050064.156100:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050064.156109:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714639360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050064.156134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050064.156154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050064.156159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714639488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050064.156174:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050064.156257:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639360 00000100:00100000:3.0:1789050064.156262:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639360 00010000:00010000:3.0:1789050064.156283:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 24 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050064.156320:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639488 00000100:00100000:3.0:1789050064.156324:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639488 00010000:00010000:3.0:1789050064.156336:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 25 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050064.156354:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050064.156361:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+25:3646:x1875954714639360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050064.156370:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050064.156375:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 25 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.156393:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 25 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.156407:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050064.156444:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+25:3646:x1875954714639360:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050064.156451:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050064.156467:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050064.156472:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714639488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050064.156480:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050064.156484:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 24 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.156491:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 24 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.156500:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050064.156517:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714639488:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050064.156522:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050064.156553:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714639488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050064.156561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714639360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050064.156865:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.156875:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 23 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.156885:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639616:0@lo:104: 00000100:00100000:0.0:1789050064.156916:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050064.157043:0:13186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d000 going to sleep for 11 seconds 00010000:00010000:0.0:1789050064.157058:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778000/0x3b8ec5973df5747f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df57478 expref: 23 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.157068:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638976:0@lo:104: 00010000:00010000:0.0:1789050064.157077:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a5200/0x3b8ec5973df57471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5746a expref: 22 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.157085:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639104:0@lo:104: 00000100:00100000:2.0:1789050064.157161:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639232 00000100:00100000:2.0:1789050064.157166:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639232 00000100:00100000:2.0:1789050064.157188:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639616 00000100:00100000:2.0:1789050064.157191:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639616 00000100:00100000:2.0:1789050064.157205:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789050064.157210:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:13186:x1875954714639232:12345-0@lo:104: 00010000:00010000:2.0:1789050064.157220:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157272:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050064.157278:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+4:13186:x1875954714639232:12345-0@lo:104: Request processed in 68us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.157284:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789050064.157297:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789050064.157324:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:13186:x1875954714639616:12345-0@lo:104: 00010000:00010000:2.0:1789050064.157332:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157365:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789050064.157371:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8839590-fd25-4606-bad2-917c49937107+3:13186:x1875954714639616:12345-0@lo:104: Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.157376:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789050064.157403:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050064.157409:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157416:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a5c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050064.157419:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157427:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050064.157434:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050064.157516:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639232:0@lo:104: 00000100:00100000:0.0:1789050064.157524:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714639616:0@lo:104: 10000000:01000000:2.0:1789050064.157783:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789050064.157814:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157820:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050064.157839:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157858:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5c00/0x3b8ec5973df5745c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57463 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157868:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050064.157871:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157877:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050064.157880:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157887:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050064.157893:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050064.157897:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789050064.157909:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157914:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050064.157920:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157926:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df5744e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df57455 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.157963:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050064.157970:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050064.157972:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050064.157985:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714639744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050064.158016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.158039:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050064.158045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714639872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050064.158064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.158095:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639744 00000100:00100000:2.0:1789050064.158100:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639744 00010000:00010000:2.0:1789050064.158117:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 22 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050064.158136:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714639872 00000100:00100000:2.0:1789050064.158139:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714639872 00010000:00010000:2.0:1789050064.158149:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 23 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050064.158166:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789050064.158173:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+23:3644:x1875954714639744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050064.158182:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050064.158186:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158194:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158206:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5745c expref: 23 pid: 6512 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158216:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050064.158249:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+22:3644:x1875954714639744:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.158256:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789050064.158268:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789050064.158275:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+21:3644:x1875954714639872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050064.158282:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050064.158286:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 21 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158293:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 21 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158303:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a5e00/0x3b8ec5973df57455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5744e expref: 21 pid: 6513 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050064.158324:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050064.158346:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+20:3644:x1875954714639872:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.158351:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789050064.158385:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714639872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050064.158394:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714639744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050064.158412:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050064.160720:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638720:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050064.162234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050064.162352:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875954714638848:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050064.162393:0:13186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050064.162515:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075008 00000100:00100000:3.0:1789050064.162524:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075008 00010000:00010000:3.0:1789050064.162561:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050064.162616:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:3.0:1789050064.162627:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704075008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050064.162643:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050064.162650:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.162661:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.162679:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a4400/0x3b8ec5973df5749b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669e2 expref: 13 pid: 6510 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050064.162694:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050064.162760:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:2404:x1875954704075008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050064.162768:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:2.0:1789050064.164001:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050064.164060:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075136 00000100:00100000:1.0:1789050064.164069:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075136 00010000:00010000:1.0:1789050064.164098:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050064.164135:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:1.0:1789050064.164145:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:2404:x1875954704075136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050064.164158:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050064.164163:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164180:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164211:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a5a00/0x3b8ec5973df57486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad39669a3 expref: 12 pid: 6512 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164227:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164236:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164251:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164260:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164267:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164275:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164281:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050064.164285:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.164293:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.164406:0:13186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050064.164416:0:13186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.166137:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.166167:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778400/0x3b8ec5973df574be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050064.166186:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050064.166289:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2404:x1875954704075136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2142us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.166299:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789050064.489232:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050064.489255:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050064.489329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.489491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714640128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050064.489514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050064.489576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640000 00000100:00100000:1.0:1789050064.489583:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640000 00000100:00100000:1.0:1789050064.489627:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640128 00000100:00100000:1.0:1789050064.489629:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640128 00000100:00100000:1.0:1789050064.489643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789050064.489651:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714640000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050064.489678:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050064.489715:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714640000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.489722:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789050064.489735:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789050064.489740:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714640128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050064.489747:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050064.489763:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714640128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.489769:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789050064.489816:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050064.489840:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982745180 x1875954714640128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050064.489858:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714640128:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789050064.489869:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982713b80 x1875954714640000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050064.489879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050064.490250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714640256:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490279:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490318:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714640768:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490356:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789050064.490361:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714640384:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490385:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490398:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714640896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640256 00000100:00100000:2.0:1789050064.490435:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640256 00000100:00100000:2.0:1789050064.490471:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640768 00000100:00100000:2.0:1789050064.490474:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640768 00000100:00100000:2.0:1789050064.490487:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640896 00000100:00100000:2.0:1789050064.490490:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640896 00000100:00100000:2.0:1789050064.490501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789050064.490507:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714640256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490547:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714640256:12345-0@lo:400:kworker.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.490553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789050064.490565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789050064.490571:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714640768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490595:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714640768:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.490601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789050064.490611:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789050064.490617:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714640896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490638:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714640896:12345-0@lo:400:kworker.0 Request processed in 22us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.490643:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789050064.490658:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640384 00000100:00100000:2.0:1789050064.490660:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640384 00000100:00100000:2.0:1789050064.490679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789050064.490684:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714640384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490717:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714640384:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.490726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789050064.490745:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050064.490748:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050064.490770:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714640384:0@lo:400:kworker.0 00010000:00080000:2.0:1789050064.490780:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c9500 x1875954714640896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050064.490799:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714640896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714640256:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490816:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714640768:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490838:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714640640:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490860:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490875:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714641152:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490908:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789050064.490913:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714640512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490931:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.490975:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714641024:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.490994:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.491016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641152 00000100:00100000:2.0:1789050064.491020:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641152 00000100:00100000:2.0:1789050064.491042:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640512 00000100:00100000:2.0:1789050064.491045:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640512 00000100:00100000:2.0:1789050064.491054:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641024 00000100:00100000:2.0:1789050064.491056:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641024 00000100:00100000:2.0:1789050064.491069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789050064.491074:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714641152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.491105:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714641152:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.491111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789050064.491121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789050064.491135:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714640512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.491161:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714640512:12345-0@lo:400:kworker.0 Request processed in 29us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.491166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789050064.491177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789050064.491183:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714641024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.491206:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714641024:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.491212:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1789050064.491225:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050064.491227:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050064.491243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714640512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.491253:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714641024:0@lo:400:kworker.0 00010000:00080000:2.0:1789050064.491262:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837ca300 x1875954714641152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050064.491270:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714641152:0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.491640:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714640640 00000100:00100000:1.0:1789050064.491645:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714640640 00000100:00100000:1.0:1789050064.491679:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789050064.491685:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714640640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.491744:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714640640:12345-0@lo:400:kworker.0 Request processed in 59us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.491751:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789050064.491815:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714640640:0@lo:400:kworker.0 00010000:00010000:1.0:1789050065.065046:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050065.353687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050065.353740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050065.353776:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050065.353797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050065.353822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050065.353856:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075392 00000100:00100000:2.0:1789050065.353867:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075392 00000100:00100000:2.0:1789050065.353929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075648 00000100:00100000:2.0:1789050065.353933:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075648 00000100:00100000:2.0:1789050065.353978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075520 00000100:00100000:2.0:1789050065.354000:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075520 00000100:00100000:2.0:1789050065.354019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075776 00000100:00100000:2.0:1789050065.354022:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075776 00000100:00100000:2.0:1789050065.354040:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:2.0:1789050065.354051:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704075392:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.354141:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704075392:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 91us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.354149:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:2.0:1789050065.354167:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789050065.354174:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704075648:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.354200:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704075648:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.354206:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789050065.354218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 191 00000100:00100000:2.0:1789050065.354224:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704075520:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.354247:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704075520:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.354254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 191 00000100:00100000:2.0:1789050065.354265:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00100000:2.0:1789050065.354271:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704075776:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.354296:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704075776:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.354311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00080000:2.0:1789050065.354336:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050065.354341:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050065.354839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075264 00000100:00100000:3.0:1789050065.354846:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075264 00000100:00100000:3.0:1789050065.354890:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 310 00000100:00100000:3.0:1789050065.354900:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2403:x1875954704075264:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050065.354958:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2403:x1875954704075264:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 60us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.354965:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 310 10000000:01000000:0.0:1789050065.513076:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050065.513089:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab4394800 from 7 10000000:01000000:0.0:1789050065.513097:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050065.513178:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.513210:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.513225:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050065.513256:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.513361:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.513447:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.514196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641280 00000100:00100000:2.0:1789050065.514207:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641280 00000100:00100000:2.0:1789050065.514276:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789050065.514288:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714641280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050065.514316:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050065.514335:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df574c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.514367:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.514380:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.514391:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177600, rc 0) 00000100:00100000:2.0:1789050065.514466:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.514473:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789050065.515787:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050065.515820:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.515835:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050065.515960:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.516021:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.516059:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.519023:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641408 00000100:00100000:2.0:1789050065.519044:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641408 00000100:00100000:2.0:1789050065.519131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789050065.519144:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.519375:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.519384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789050065.519546:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.519619:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.519686:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050065.519719:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050065.519837:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641536 00000100:00100000:3.0:1789050065.519848:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641536 00000100:00100000:3.0:1789050065.519880:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789050065.519887:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050065.527269:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7366us (7566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.527288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789050065.534147:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789050065.541074:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789050065.543582:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789050065.543634:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050065.543649:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.543665:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050065.543705:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050065.543708:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac621000 from 7 10000000:01000000:0.0:1789050065.543711:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050065.543776:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.543785:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.543800:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050065.543833:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.543933:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.544019:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050065.544179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641664 00000100:00100000:1.0:1789050065.544191:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641664 00000100:00100000:1.0:1789050065.544260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789050065.544271:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714641664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050065.544286:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050065.544311:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df574d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.544343:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.544357:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.544367:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7c00, rc 0) 00000100:00100000:1.0:1789050065.544415:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714641664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050065.544422:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789050065.550034:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050065.550073:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.550088:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050065.550207:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.550283:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.550340:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050065.552562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641792 00000100:00100000:3.0:1789050065.552581:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641792 00000100:00100000:3.0:1789050065.552663:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789050065.552676:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714641792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050065.552891:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714641792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.552900:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789050065.553136:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.553198:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.553258:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.553314:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050065.553361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714641920 00000100:00100000:3.0:1789050065.553366:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714641920 00000100:00100000:3.0:1789050065.553400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789050065.553408:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714641920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050065.553500:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714641920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.553508:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789050065.553632:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714641920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050065.556807:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789050065.563188:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789050065.563236:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050065.563252:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.563268:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050065.563316:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050065.563321:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab0ea0000 from 7 10000000:01000000:0.0:1789050065.563324:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050065.563376:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.563385:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.563399:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050065.564341:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.564446:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050065.564664:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.569776:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642048 00000100:00100000:2.0:1789050065.569795:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642048 00000100:00100000:2.0:1789050065.569863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789050065.569875:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714642048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050065.569896:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050065.569920:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df574e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.569970:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.569983:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.569993:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:2.0:1789050065.570085:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.570093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789050065.574087:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050065.574128:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.574174:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050065.574307:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050065.574391:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050065.574456:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982435480 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.574930:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642176 00000100:00100000:2.0:1789050065.574959:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642176 00000100:00100000:2.0:1789050065.575024:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789050065.575036:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.575191:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.575199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789050065.575382:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050065.575435:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050065.575485:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050065.575509:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba982435480 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.575554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642304 00000100:00100000:2.0:1789050065.575559:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642304 00000100:00100000:2.0:1789050065.575593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789050065.575600:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.575679:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.575686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789050065.575930:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789050065.577325:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789050065.577627:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789050065.577651:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050065.577664:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.577677:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050065.577689:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050065.577693:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac606800 from 7 10000000:01000000:2.0:1789050065.577696:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050065.577752:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.577761:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.577773:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050065.577798:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.577863:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050065.577901:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.577989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642432 00000100:00100000:2.0:1789050065.577997:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642432 00000100:00100000:2.0:1789050065.578048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789050065.578059:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714642432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050065.578072:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050065.578086:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df574ef expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.578113:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.578124:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.578133:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177c00, rc 0) 00000100:00100000:2.0:1789050065.578171:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714642432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.578179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789050065.578226:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050065.578241:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.578251:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050065.578320:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.578346:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050065.578365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642560 00000100:00100000:2.0:1789050065.578376:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642560 00000100:00100000:2.0:1789050065.578398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789050065.578404:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714642560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.589215:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714642560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10798us (10855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.589231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789050065.589345:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050065.589377:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.589454:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050065.589516:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050065.589563:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050065.589769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642688 00000100:00100000:1.0:1789050065.589778:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642688 00000100:00100000:1.0:1789050065.589837:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789050065.589849:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714642688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050065.589987:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714642688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050065.589995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789050065.590319:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714642688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789050065.593261:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789050065.593515:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789050065.593553:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050065.593568:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.593582:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050065.738271:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050065.738824:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075904 00000100:00100000:3.0:1789050065.738841:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075904 00000100:00100000:3.0:1789050065.739986:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 323 00000100:00100000:3.0:1789050065.740003:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:6177:x1875954704075904:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050065.740024:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050065.740055:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050065.740094:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050065.740109:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050065.740120:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603600, rc 0) 00000100:00100000:3.0:1789050065.740207:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704075904:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 209us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.740215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 323 00000100:00100000:0.0:1789050065.748472:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050065.749283:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076032 00000100:00100000:3.0:1789050065.749307:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076032 00000100:00100000:3.0:1789050065.749378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 324 00000100:00100000:3.0:1789050065.749389:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704076032:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050065.749760:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704076032:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 371us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.749768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 324 00000100:00100000:0.0:1789050065.752047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050065.752516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076160 00000100:00100000:3.0:1789050065.752527:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076160 00000100:00100000:3.0:1789050065.752592:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 325 00000100:00100000:3.0:1789050065.752604:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704076160:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050065.752775:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704076160:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 172us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.752783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 325 00000100:00100000:3.0:1789050065.757067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050065.757667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076288 00000100:00100000:0.0:1789050065.757693:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076288 00000100:00100000:0.0:1789050065.757766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 326 00000100:00100000:0.0:1789050065.757779:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704076288:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050065.757799:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050065.757825:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a1a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.757872:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.757887:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050065.757899:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778a00, rc 0) 00000100:00100000:0.0:1789050065.757996:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704076288:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 220us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050065.758004:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 326 00000100:00100000:0.0:1789050065.769737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050065.771691:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076416 00000100:00100000:0.0:1789050065.771711:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076416 00000100:00100000:0.0:1789050065.771792:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 327 00000100:00100000:0.0:1789050065.771805:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704076416:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.772031:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704076416:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 228us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050065.772040:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 327 00000100:00100000:2.0:1789050065.785856:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050065.785981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076544 00000100:00100000:0.0:1789050065.785996:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076544 00000100:00100000:0.0:1789050065.786085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 328 00000100:00100000:0.0:1789050065.786099:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704076544:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050065.786303:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704076544:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 198us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050065.786312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 328 00010000:00010000:0.0:1789050066.090159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050067.053023:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714642816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050067.053120:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050067.053310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642816 00000100:00100000:1.0:1789050067.053321:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642816 00000100:00100000:1.0:1789050067.053391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789050067.053403:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714642816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050067.053445:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050067.053713:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714642816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 312us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050067.053722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789050067.053798:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714642816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789050067.127173:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050067.565769:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050067.565796:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714642944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050067.565880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050067.565981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714642944 00000100:00100000:2.0:1789050067.565991:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714642944 00000100:00100000:2.0:1789050067.566048:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789050067.566056:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714642944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050067.566097:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050067.566142:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714642944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050067.566149:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789050067.566198:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714642944:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050068.137260:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050069.097434:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714643072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050069.097539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.097861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714643200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050069.097905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.097970:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643072 00000100:00100000:2.0:1789050069.097980:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643072 00000100:00100000:2.0:1789050069.098038:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643200 00000100:00100000:2.0:1789050069.098042:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643200 00000100:00100000:2.0:1789050069.098064:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789050069.098074:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714643072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050069.098111:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050069.098334:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714643072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.098342:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789050069.098360:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789050069.098366:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714643200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050069.098385:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050069.098423:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714643200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.098430:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789050069.098448:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789050069.098546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982713b80 x1875954714643200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050069.098568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714643200:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789050069.098668:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983688a80 x1875954714643072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050069.098682:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714643072:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050069.165599:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050069.601843:0:13384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789050069.609159:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050069.609188:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714643328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050069.609296:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.609388:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643328 00000100:00100000:2.0:1789050069.609398:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643328 00000100:00100000:2.0:1789050069.609462:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789050069.609475:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714643328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050069.609510:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050069.609597:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714643328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.609605:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789050069.609628:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050069.609664:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368a300 x1875954714643328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050069.609683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714643328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050069.610368:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714643456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050069.610423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050069.610469:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643456 00000100:00100000:1.0:1789050069.610476:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643456 00000100:00100000:1.0:1789050069.610519:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789050069.610527:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714643456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050069.610542:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050069.610580:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714643456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050069.610586:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789050069.610603:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789050069.610623:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837caa00 x1875954714643456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050069.610637:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714643456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050069.610854:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714643712:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.610888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.610909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714644224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.610929:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.611016:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714643584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.611069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.611093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714644096:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.611117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.611131:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714644608:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643712 00000100:00100000:2.0:1789050069.611339:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643712 00000100:00100000:2.0:1789050069.611375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644224 00000100:00100000:2.0:1789050069.611378:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644224 00000100:00100000:2.0:1789050069.611406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789050069.611413:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714643712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611454:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714643712:12345-0@lo:400:kworker.0 Request processed in 42us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.611461:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789050069.611475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789050069.611481:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714644224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611509:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714644224:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.611515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789050069.611542:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714643840:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.611583:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714644352:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.611615:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789050069.611620:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714643968:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611639:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.611652:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714644480:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.611693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644096 00000100:00100000:2.0:1789050069.611697:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644096 00000100:00100000:2.0:1789050069.611722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643840 00000100:00100000:2.0:1789050069.611724:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643840 00000100:00100000:2.0:1789050069.611738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789050069.611753:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714644096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611788:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714644096:12345-0@lo:400:kworker.0 Request processed in 37us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.611794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789050069.611807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789050069.611814:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714643840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.611843:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714643840:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.611848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789050069.611866:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644352 00000100:00100000:2.0:1789050069.611869:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644352 00000100:00100000:2.0:1789050069.611890:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643968 00000100:00100000:2.0:1789050069.611892:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643968 00000100:00100000:2.0:1789050069.611902:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644480 00000100:00100000:2.0:1789050069.611904:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644480 00000100:00100000:2.0:1789050069.611916:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789050069.611921:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714644352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050069.612810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714643584 00000100:00100000:1.0:1789050069.612821:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714643584 00000100:00100000:1.0:1789050069.612869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789050069.612878:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714643584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050069.612932:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714643584:12345-0@lo:400:kworker.0 Request processed in 54us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050069.612966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:1.0:1789050069.613009:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789050069.613023:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050069.613543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.613600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714643584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.613616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714644096:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.614223:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714644352:12345-0@lo:400:kworker.0 Request processed in 2297us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.614234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789050069.614260:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644608 00000100:00100000:2.0:1789050069.614276:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644608 00000100:00100000:2.0:1789050069.614328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789050069.614337:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714643968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.614387:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714643968:12345-0@lo:400:kworker.0 Request processed in 51us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.614756:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789050069.614791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789050069.614800:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714644480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.614833:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714644480:12345-0@lo:400:kworker.0 Request processed in 36us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.614839:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789050069.614849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789050069.614855:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714644608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789050069.614952:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050069.615011:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714644608:12345-0@lo:400:kworker.0 Request processed in 156us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.615017:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789050069.615070:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714643712:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.615085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714644224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.615119:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714643968:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.615129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714644480:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.615141:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714643840:0@lo:400:kworker.0 00010000:00080000:2.0:1789050069.615153:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368df80 x1875954714644352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050069.615163:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714644352:0@lo:400:kworker.0 00010000:00080000:0.0:1789050069.618101:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368ca80 x1875954714644608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050069.618125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714644608:0@lo:400:kworker.0 00010000:00010000:2.0:1789050070.185845:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050070.477075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050070.477110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050070.477134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050070.477150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050070.477192:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050070.477225:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076928 00000100:00100000:2.0:1789050070.477237:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076928 00000100:00100000:2.0:1789050070.477314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077184 00000100:00100000:2.0:1789050070.477317:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077184 00000100:00100000:2.0:1789050070.477331:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076800 00000100:00100000:2.0:1789050070.477333:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076800 00000100:00100000:2.0:1789050070.477344:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077056 00000100:00100000:2.0:1789050070.477345:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077056 00000100:00100000:2.0:1789050070.477360:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:2.0:1789050070.477370:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704076928:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050070.477451:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704076928:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 82us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.477458:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:2.0:1789050070.477477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:2.0:1789050070.477483:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704077184:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050070.477507:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704077184:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.477513:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:2.0:1789050070.477525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00100000:2.0:1789050070.477531:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9834a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704076800:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050070.477557:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9834a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2406:x1875954704076800:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.477563:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00100000:2.0:1789050070.477574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:2.0:1789050070.477581:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704077056:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050070.477613:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704077056:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.477619:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00080000:2.0:1789050070.477660:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050070.477665:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050070.477915:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076672 00000100:00100000:0.0:1789050070.477922:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076672 00000100:00100000:0.0:1789050070.477984:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 330 00000100:00100000:0.0:1789050070.477992:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704076672:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050070.478025:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704076672:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 35us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050070.478031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 330 00010000:00010000:1.0:1789050071.209733:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050072.172422:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050072.172446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714644736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050072.172517:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050072.177120:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644736 00000100:00100000:1.0:1789050072.177135:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644736 00000100:00100000:1.0:1789050072.177335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789050072.177347:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714644736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050072.177389:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050072.177482:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714644736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050072.177489:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789050072.177579:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714644736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050072.235625:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050072.684082:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050072.684107:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714644864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050072.684178:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050072.684269:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644864 00000100:00100000:2.0:1789050072.684277:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644864 00000100:00100000:2.0:1789050072.684328:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789050072.684337:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714644864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050072.684375:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050072.684421:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714644864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050072.684428:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789050072.684474:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714644864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050073.257506:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050074.217474:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714644992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050074.217581:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050074.217601:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714645120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050074.217679:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.217756:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645120 00000100:00100000:2.0:1789050074.217764:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645120 00000100:00100000:2.0:1789050074.217822:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789050074.217834:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714645120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050074.217865:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050074.217979:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714645120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.217986:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789050074.218016:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789050074.218048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368d880 x1875954714645120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050074.218068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714645120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050074.218803:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.218993:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714644992 00000100:00100000:2.0:1789050074.219004:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714644992 00000100:00100000:2.0:1789050074.219066:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789050074.219076:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714644992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050074.219093:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050074.219150:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714644992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.219157:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789050074.219194:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba98368df80 x1875954714644992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050074.219209:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714644992:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789050074.219291:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789050074.281216:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050074.294033:0:13533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:21:11 (1789050071) === 00000100:00100000:3.0:1789050074.470720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.470756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.470785:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077312 00000100:00100000:3.0:1789050074.470866:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077312 00000100:00100000:3.0:1789050074.471028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:3.0:1789050074.471040:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704077312:12345-192.168.203.42@tcp:41:mkdir.0 00000004:00000024:3.0:1789050074.471082:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789050074.471165:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704077312:12345-192.168.203.42@tcp:41:mkdir.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.471173:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:3.0:1789050074.471202:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077440 00000100:00100000:3.0:1789050074.471206:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077440 00000100:00100000:3.0:1789050074.471228:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:3.0:1789050074.471245:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:615c64c6-0403-4edc-8952-4a12704f5533+6:10523:x1875954704077440:12345-192.168.203.42@tcp:700:mkdir.0 00000100:00100000:3.0:1789050074.471277:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:615c64c6-0403-4edc-8952-4a12704f5533+6:10523:x1875954704077440:12345-192.168.203.42@tcp:700:mkdir.0 Request processed in 42us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.471283:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00080000:3.0:1789050074.471299:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050074.478683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.478947:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077696 00000100:00100000:3.0:1789050074.478957:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077696 00000100:00100000:3.0:1789050074.479013:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:3.0:1789050074.479031:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:10523:x1875954704077696:12345-192.168.203.42@tcp:36:mkdir.0 00010000:00010000:3.0:1789050074.479088:0:10357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050074.479148:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae5a5000/0x3b8ec5973df573ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396698e expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.479167:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa9307b300) 00010000:00010000:3.0:1789050074.486623:0:10357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050074.487608:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.487627:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.487637:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.488542:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.488556:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.488566:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.489334:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.489347:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.489354:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050074.497519:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007de38ea7 reply state 000000001fc3c15c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497539:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497549:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050074.497552:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050074.497558:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789050074.497566:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789050074.497577:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497584:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497591:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497599:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050074.497604:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497612:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497622:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:3.0:1789050074.497625:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050074.497628:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497651:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5750b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050074.497690:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007de38ea7 reply state 000000001fc3c15c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497700:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.497706:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050074.497709:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050074.497711:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789050074.497978:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:10523:x1875954704077696:12345-192.168.203.42@tcp:36:mkdir.0 Request processed in 18943us (19311us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789050074.497988:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:3.0:1789050074.514490:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.514575:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077824 00000100:00100000:2.0:1789050074.514585:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077824 00000100:00100000:2.0:1789050074.514672:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789050074.514682:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:10524:x1875954704077824:12345-192.168.203.42@tcp:101:chmod.0 00010000:00010000:2.0:1789050074.514707:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050074.514730:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a21 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.514833:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.514847:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.514859:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050074.514908:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789050074.514913:0:6519:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050074.517078:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.517135:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a21 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.517157:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a21 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.517167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa9307b400) 00010000:00010000:2.0:1789050074.517171:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050074.517174:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031600, rc 0) 00000100:00100000:2.0:1789050074.517257:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:10524:x1875954704077824:12345-192.168.203.42@tcp:101:chmod.0 Request processed in 2575us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.517266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789050074.528151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.528246:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078080 00000100:00100000:1.0:1789050074.528256:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078080 00000100:00100000:1.0:1789050074.528318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789050074.528331:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:10524:x1875954704078080:12345-192.168.203.42@tcp:36:chmod.0 00010000:00010000:1.0:1789050074.528393:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050074.528422:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df57527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a21 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.528444:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa9307b400) 00010000:00010000:1.0:1789050074.528455:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050074.528483:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.528495:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.528504:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050074.528710:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000935b334a reply state 000000009c949bc3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.528722:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.528729:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:1.0:1789050074.528731:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789050074.528734:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789050074.528742:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789050074.528839:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:10524:x1875954704078080:12345-192.168.203.42@tcp:36:chmod.0 Request processed in 510us (697us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789050074.528846:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789050074.558770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.559863:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078208 00000100:00100000:3.0:1789050074.559875:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078208 00000100:00100000:2.0:1789050074.560111:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:2.0:1789050074.560122:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:10525:x1875954704078208:12345-192.168.203.42@tcp:101:chown.0 00010000:00010000:2.0:1789050074.560165:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050074.560188:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df57535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a28 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560270:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560285:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560386:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050074.560433:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789050074.560437:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050074.560662:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560692:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df57535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a28 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560712:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a28 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.560721:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:2.0:1789050074.560724:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050074.560727:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030200, rc 0) 00000100:00100000:2.0:1789050074.560902:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+10:10525:x1875954704078208:12345-192.168.203.42@tcp:101:chown.0 Request processed in 781us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.560910:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:2.0:1789050074.565716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.565879:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078336 00000100:00100000:3.0:1789050074.565890:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078336 00000100:00100000:3.0:1789050074.566062:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:3.0:1789050074.566073:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+10:10525:x1875954704078336:12345-192.168.203.42@tcp:101:chown.0 00010000:00010000:3.0:1789050074.566096:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050074.566118:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df57543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a2f expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566188:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566217:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566229:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566253:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566260:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566268:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566345:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566354:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566371:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.566409:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789050074.566412:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050074.566445:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566457:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566473:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566480:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566486:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050074.566491:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566500:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566513:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:3.0:1789050074.566517:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050074.566521:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566527:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5754a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566541:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566547:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566553:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566558:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050074.566566:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566573:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566580:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050074.566583:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050074.566586:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566592:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566618:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df57543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a2f expref: 12 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566630:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a2f expref: 11 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.566637:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050074.566640:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050074.566642:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:3.0:1789050074.566692:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+11:10525:x1875954704078336:12345-192.168.203.42@tcp:101:chown.0 Request processed in 622us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.566699:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789050074.585446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.585557:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078464 00000100:00100000:2.0:1789050074.585573:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078464 00000100:00100000:2.0:1789050074.585657:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789050074.585668:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:615c64c6-0403-4edc-8952-4a12704f5533+11:10525:x1875954704078464:12345-192.168.203.42@tcp:900:chown.0 00000100:00100000:2.0:1789050074.585768:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:615c64c6-0403-4edc-8952-4a12704f5533+11:10525:x1875954704078464:12345-192.168.203.42@tcp:900:chown.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.585776:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789050074.588384:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.588477:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078720 00000100:00100000:3.0:1789050074.588492:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078720 00000100:00100000:3.0:1789050074.588565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789050074.588578:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+11:10525:x1875954704078720:12345-192.168.203.42@tcp:36:chown.0 00010000:00010000:3.0:1789050074.588677:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050074.588709:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a2f expref: 11 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.588735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050074.588741:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050074.588768:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.588784:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.588795:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050074.592532:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1789050074.592657:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b3360bb2 reply state 00000000d04693ce transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.592687:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.592698:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050074.592701:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789050074.592707:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050074.592709:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.592722:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789050074.592724:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592738:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592746:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.592752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592762:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592783:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8baa83dbbe00) 00010000:00010000:2.0:1789050074.592786:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050074.592792:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592799:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603800/0x3b8ec5973df57512 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789050074.592840:0:6519:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1789050074.592861:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050074.592876:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+9:10525:x1875954704078720:12345-192.168.203.42@tcp:36:chown.0 Request processed in 4290us (4505us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1789050074.592879:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.592902:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050074.592904:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:2.0:1789050074.592917:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.592922:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593162:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593173:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593181:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593189:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.593194:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593203:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593216:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:1.0:1789050074.593231:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050074.593245:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.593252:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603a00/0x3b8ec5973df5755f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593565:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593578:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:2.0:1789050074.593580:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050074.593584:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593591:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57519 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593619:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593625:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593631:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593646:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.593649:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593655:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593663:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:2.0:1789050074.593677:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050074.593681:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.593686:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5752e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050074.617228:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.617699:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078848 00000100:00100000:1.0:1789050074.617715:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078848 00000100:00100000:1.0:1789050074.617796:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789050074.617808:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:10526:x1875954704078848:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:1.0:1789050074.617836:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050074.617858:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050074.619476:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1561us 00010000:00010000:1.0:1789050074.648163:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648185:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648198:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648214:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648221:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648228:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648352:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648360:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648367:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050074.648400:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789050074.648404:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050074.648444:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648456:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648462:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648469:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648475:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.648479:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648486:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648496:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:1.0:1789050074.648504:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050074.648509:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648515:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5756d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648526:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648531:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648537:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648541:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.648544:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648549:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648556:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba9832fce00) 00010000:00010000:1.0:1789050074.648558:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050074.648560:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648566:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57574 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648601:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a36 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648626:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a36 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.648633:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:1.0:1789050074.648636:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789050074.648638:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043000, rc 0) 00000100:00100000:1.0:1789050074.648709:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:10526:x1875954704078848:12345-192.168.203.42@tcp:101:touch.500 Request processed in 30902us (31495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.648717:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:0.0:1789050074.662398:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.662495:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079104 00000100:00100000:2.0:1789050074.662506:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079104 00000100:00100000:2.0:1789050074.662572:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:2.0:1789050074.662583:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:10526:x1875954704079104:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:2.0:1789050074.662607:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050074.662628:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df57582 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a3d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662738:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662752:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662778:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662792:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662799:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.662806:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050074.663224:0:6520:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789050074.663392:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663402:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663410:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663446:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663454:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663461:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663467:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.663477:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663485:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663499:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:2.0:1789050074.663503:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050074.663508:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663515:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57589 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050074.663530:0:6520:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000bfa7de8b reply state 00000000d659e96a transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663541:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663546:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8baa9307b300) 00010000:00010000:2.0:1789050074.663549:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050074.663551:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050074.663580:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df57582 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a3d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663595:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a3d expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.663602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa9307ba00) 00010000:00010000:2.0:1789050074.663604:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050074.663611:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030c00, rc 0) 00000100:00100000:2.0:1789050074.663677:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+10:10526:x1875954704079104:12345-192.168.203.42@tcp:101:touch.500 Request processed in 1096us (1290us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789050074.663685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789050074.668444:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.668515:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079360 00000100:00100000:3.0:1789050074.668528:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079360 00000100:00100000:3.0:1789050074.668592:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:3.0:1789050074.668602:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+10:10526:x1875954704079360:12345-192.168.203.42@tcp:36:touch.500 00010000:00010000:3.0:1789050074.668663:0:10357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050074.668690:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a3d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.668708:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa9307ba00) 00010000:00010000:3.0:1789050074.668718:0:10357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050074.668776:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.668792:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.668802:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050074.668925:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000009eb94dab reply state 0000000076046f60 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.668975:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.668983:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:3.0:1789050074.668986:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050074.668988:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050074.669075:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+11:10526:x1875954704079360:12345-192.168.203.42@tcp:36:touch.500 Request processed in 474us (639us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789050074.669099:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789050074.674853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.674961:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079488 00000100:00100000:2.0:1789050074.674971:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079488 00000100:00100000:2.0:1789050074.675024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:2.0:1789050074.675034:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+11:10526:x1875954704079488:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:2.0:1789050074.675060:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050074.675080:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df575ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a44 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.675137:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df575ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a44 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.675152:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df575ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a44 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.675170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050074.675173:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050074.675177:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031200, rc 0) 00000100:00100000:2.0:1789050074.675226:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+12:10526:x1875954704079488:12345-192.168.203.42@tcp:101:touch.500 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.675243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:0.0:1789050074.680283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.680391:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079616 00000100:00100000:3.0:1789050074.680402:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079616 00000100:00100000:3.0:1789050074.680451:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:3.0:1789050074.680459:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875954704079616:12345-192.168.203.42@tcp:8:touch.500 00010000:00080000:3.0:1789050074.680494:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:3.0:1789050074.680527:0:8432:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df575b3 00002000:00100000:3.0:1789050074.680539:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 615c64c6-0403-4edc-8952-4a12704f5533/ffff8baab7854800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789050074.680558:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1789050074.680636:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789050074.680670:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8baab7857000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050074.680754:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704079616:12345-192.168.203.42@tcp:8:touch.500 Request processed in 293us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.680762:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789050074.687043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.687139:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079744 00000100:00100000:3.0:1789050074.687148:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079744 00000100:00100000:3.0:1789050074.687222:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789050074.687430:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:0:x1875954704079744:12345-192.168.203.42@tcp:2:touch.500 00000100:00080000:0.0:1789050074.687902:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789050074.688976:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1789050074.688988:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000100:00100000:3.0:1789050074.689221:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704079744:12345-192.168.203.42@tcp:2:touch.500 Request processed in 1985us (2184us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789050074.689231:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789050074.696928:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.697084:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080000 00000100:00100000:3.0:1789050074.697095:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080000 00000100:00100000:3.0:1789050074.697157:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:3.0:1789050074.697168:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+12:10526:x1875954704080000:12345-192.168.203.42@tcp:35:touch.500 00000100:00100000:3.0:1789050074.697486:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+13:10526:x1875954704080000:12345-192.168.203.42@tcp:35:touch.500 Request processed in 319us (567us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789050074.697493:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:0.0:1789050074.729152:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050074.729178:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714645248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050074.729268:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050074.729397:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645248 00000100:00100000:1.0:1789050074.729407:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645248 00000100:00100000:1.0:1789050074.729482:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789050074.729492:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714645248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050074.729520:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050074.729571:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714645248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.729579:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1789050074.729617:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c8380 x1875954714645248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050074.729635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714645248:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789050074.729757:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050074.730112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714645760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050074.730179:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714646272:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730198:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050074.730215:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789050074.730220:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714645632:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050074.730269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714646144:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730287:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050074.730310:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645760 00000100:00100000:3.0:1789050074.730316:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645760 00000100:00100000:3.0:1789050074.730344:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646272 00000100:00100000:3.0:1789050074.730346:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646272 00000100:00100000:3.0:1789050074.730374:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646144 00000100:00100000:3.0:1789050074.730376:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646144 00000100:00100000:3.0:1789050074.730390:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789050074.730397:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714645760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730434:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714645760:12345-0@lo:400:kworker.0 Request processed in 38us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.730440:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789050074.730458:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789050074.730463:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714646272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730486:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714646272:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.730503:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789050074.730514:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789050074.730519:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714646144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730545:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714646144:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.730550:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:3.0:1789050074.730574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794700 x1875954714646144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050074.730584:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714646144:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730592:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714645760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.730599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714646272:0@lo:400:kworker.0 00000100:00080000:0.0:1789050074.730759:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050074.730762:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050074.730892:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714645504:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.730930:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.730980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714646016:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731000:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.731011:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714646528:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.731048:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789050074.731054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714645376:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.731098:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714645888:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731117:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.731133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714646400:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731152:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050074.731172:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645632 00000100:00100000:2.0:1789050074.731178:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645632 00000100:00100000:2.0:1789050074.731208:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645888 00000100:00100000:2.0:1789050074.731211:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645888 00000100:00100000:2.0:1789050074.731224:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789050074.731230:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714645632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731284:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714645632:12345-0@lo:400:kworker.0 Request processed in 53us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.731290:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789050074.731304:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789050074.731311:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714645888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.731342:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714645888:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.731358:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789050074.731456:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645504 00000100:00100000:0.0:1789050074.731461:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645504 00000100:00100000:0.0:1789050074.731480:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646016 00000100:00100000:0.0:1789050074.731482:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646016 00000100:00100000:0.0:1789050074.731502:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646400 00000100:00100000:0.0:1789050074.731505:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646400 00000100:00100000:0.0:1789050074.731517:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789050074.731523:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714645504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.731557:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714645504:12345-0@lo:400:kworker.0 Request processed in 34us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.731562:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789050074.731574:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789050074.731580:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714646016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.731605:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714646016:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.731611:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789050074.731620:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789050074.731626:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714646400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.731650:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714646400:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.731655:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1789050074.731679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050074.731683:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050074.731817:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714645888:0@lo:400:kworker.0 00010000:00080000:2.0:1789050074.731830:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794380 x1875954714646400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050074.731838:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714646400:0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.731974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714645376 00000100:00100000:1.0:1789050074.731980:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714645376 00000100:00100000:1.0:1789050074.732019:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789050074.732027:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714645376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.732070:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714645376:12345-0@lo:400:kworker.0 Request processed in 45us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.732077:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789050074.732110:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714646656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050074.732138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050074.732172:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646656 00000100:00100000:1.0:1789050074.732176:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646656 00000100:00100000:1.0:1789050074.732209:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050074.732216:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714646656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050074.732250:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050074.732286:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714646656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.732292:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789050074.732305:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789050074.732324:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c58000 x1875954714646656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050074.732339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714646656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050074.733340:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714645504:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.733501:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714645632:0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.733534:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646528 00000100:00100000:3.0:1789050074.733539:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646528 00000100:00100000:3.0:1789050074.733591:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789050074.733600:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714646528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.733653:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714646528:12345-0@lo:400:kworker.0 Request processed in 55us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.733659:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789050074.735794:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714646016:0@lo:400:kworker.0 00010000:00080000:2.0:1789050074.735833:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794a80 x1875954714646528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050074.735845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714646528:0@lo:400:kworker.0 00000100:00100000:2.0:1789050074.736030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714645376:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.740542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.740746:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080128 00000100:00100000:3.0:1789050074.740756:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080128 00000100:00100000:3.0:1789050074.740819:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:3.0:1789050074.740830:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+13:10527:x1875954704080128:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:3.0:1789050074.740879:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050074.740899:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a4b expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741016:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741031:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741043:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.741086:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789050074.741090:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050074.741143:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741170:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a4b expref: 15 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741189:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a4b expref: 14 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.741198:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:3.0:1789050074.741201:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050074.741204:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602200, rc 0) 00000100:00100000:3.0:1789050074.741268:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+14:10527:x1875954704080128:12345-192.168.203.42@tcp:101:rm.0 Request processed in 439us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.741275:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:0.0:1789050074.753322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.754412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080384 00000100:00100000:3.0:1789050074.754425:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080384 00000100:00100000:3.0:1789050074.754498:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:3.0:1789050074.754507:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+14:10527:x1875954704080384:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:3.0:1789050074.754534:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050074.754557:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a52 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.754674:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789050074.754833:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a52 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.754848:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:3.0:1789050074.754851:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050074.754856:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a52 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.754869:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050074.755640:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:10527:x1875954704080384:12345-192.168.203.42@tcp:101:rm.0 Request processed in 1130us (2323us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789050074.755650:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:0.0:1789050074.761833:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.761924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080512 00000100:00100000:3.0:1789050074.761973:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080512 00000100:00100000:3.0:1789050074.762052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:3.0:1789050074.762068:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:10527:x1875954704080512:12345-192.168.203.42@tcp:37:rm.0 00000100:00100000:3.0:1789050074.766335:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:10527:x1875954704080512:12345-192.168.203.42@tcp:37:rm.0 Request processed in 4260us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.766361:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789050074.772082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.772247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080768 00000100:00100000:1.0:1789050074.772256:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080768 00000100:00100000:1.0:1789050074.772330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789050074.772344:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+15:10527:x1875954704080768:12345-192.168.203.42@tcp:35:rm.0 00000100:00100000:1.0:1789050074.772632:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:10527:x1875954704080768:12345-192.168.203.42@tcp:35:rm.0 Request processed in 289us (569us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789050074.772642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789050074.779031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050074.779453:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081024 00000100:00100000:3.0:1789050074.779462:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081024 00000100:00100000:3.0:1789050074.779523:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:3.0:1789050074.779532:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+16:10527:x1875954704081024:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:3.0:1789050074.779559:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050074.779580:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a59 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.779699:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df575dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.779715:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df575dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.779727:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df575dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.780055:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789050074.780195:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df575d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a59 expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.780213:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df575dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a59 expref: 18 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.780222:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:3.0:1789050074.780225:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050074.780228:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050074.780317:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081024:12345-192.168.203.42@tcp:101:rm.0 Request processed in 785us (1295us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789050074.780324:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789050074.790442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.790552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081152 00000100:00100000:2.0:1789050074.790562:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081152 00000100:00100000:2.0:1789050074.790627:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:2.0:1789050074.790639:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081152:12345-192.168.203.42@tcp:41:rm.0 00000004:00000024:2.0:1789050074.790715:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789050074.790802:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081152:12345-192.168.203.42@tcp:41:rm.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050074.790809:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:0.0:1789050074.794210:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.794289:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081280 00000100:00100000:1.0:1789050074.794317:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081280 00000100:00100000:1.0:1789050074.794386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:1.0:1789050074.794397:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081280:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:1.0:1789050074.794427:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050074.794450:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df575eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794529:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794545:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794559:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794571:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794578:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794585:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794691:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794701:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794708:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050074.794883:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789050074.794888:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050074.794913:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794927:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794960:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794967:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.794974:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795044:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.795049:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795057:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795070:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:1.0:1789050074.795073:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050074.795077:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795083:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df575f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795108:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795116:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795121:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795127:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.795130:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795136:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795144:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8baa9307b300) 00010000:00010000:1.0:1789050074.795147:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050074.795150:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795155:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df575f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795185:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df575eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a60 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795199:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a60 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.795218:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:1.0:1789050074.795220:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050074.795223:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042800, rc 0) 00000100:00100000:1.0:1789050074.795303:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:10527:x1875954704081280:12345-192.168.203.42@tcp:101:rm.0 Request processed in 906us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.795311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789050074.803879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050074.804287:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081536 00000100:00100000:2.0:1789050074.804297:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081536 00000100:00100000:2.0:1789050074.804358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789050074.804375:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+19:10527:x1875954704081536:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:2.0:1789050074.804444:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789050074.804473:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df57600 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a60 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804495:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df575ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a44 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804507:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050074.804516:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df575c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a4b expref: 17 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804525:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:2.0:1789050074.804528:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050074.804546:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804560:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804569:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804578:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804585:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804591:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804711:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804719:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.804726:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050074.804921:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789050074.804968:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297003029702ns, next at 298003026849ns, rc = 0 00010000:00010000:2.0:1789050074.806517:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806679:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806693:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806701:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806706:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806712:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806786:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050074.806811:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806829:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806834:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806840:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.806845:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806852:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806865:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050074.806869:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789050074.806874:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806879:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df57615 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806899:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806906:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806912:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806917:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050074.806927:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806934:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806959:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:2.0:1789050074.806961:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050074.806965:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.806971:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df57607 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050074.806990:0:6520:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000bba4379a reply state 000000003dddf867 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.807001:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050074.807007:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8baa9307b300) 00010000:00010000:2.0:1789050074.807010:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050074.807013:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050074.807104:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081536:12345-192.168.203.42@tcp:36:rm.0 Request processed in 2726us (3231us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789050074.807113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00010000:00010000:1.0:1789050074.814739:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050074.814759:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.814772:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050074.814777:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.814789:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.814812:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:1.0:1789050074.814816:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050074.814821:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.814827:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df5761c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.814846:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050074.814849:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050074.814851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050074.822332:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.822477:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081792 00000100:00100000:1.0:1789050074.822500:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081792 00000100:00100000:1.0:1789050074.822556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789050074.822565:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704081792:12345-192.168.203.42@tcp:35:rm.0 00000100:00100000:1.0:1789050074.822858:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:10527:x1875954704081792:12345-192.168.203.42@tcp:35:rm.0 Request processed in 293us (536us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789050074.822866:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789050074.830920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050074.831166:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082048 00000100:00100000:1.0:1789050074.831179:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082048 00000100:00100000:1.0:1789050074.831253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:1.0:1789050074.831264:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:10527:x1875954704082048:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:1.0:1789050074.831331:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789050074.831372:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df575dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a59 expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831398:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df5757b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a36 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831411:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc700) 00010000:00010000:1.0:1789050074.831428:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df5753c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a28 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831439:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fcc00) 00010000:00010000:1.0:1789050074.831446:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050074.831470:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831483:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831507:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831520:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831527:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831534:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831616:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831625:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831633:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050074.831880:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789050074.831897:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831905:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831912:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.831918:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.831930:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832130:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832141:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ba9832fc900) 00010000:00010000:1.0:1789050074.832144:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789050074.832148:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832154:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57631 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832172:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832179:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832184:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832190:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050074.832193:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832198:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832205:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba9832fce00) 00010000:00010000:1.0:1789050074.832207:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050074.832217:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832223:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57623 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050074.832245:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d252a645 reply state 00000000c6c5fb2b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832257:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050074.832263:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba9832fc200) 00010000:00010000:1.0:1789050074.832265:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789050074.832269:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050074.832354:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+18:10527:x1875954704082048:12345-192.168.203.42@tcp:36:rm.0 Request processed in 1089us (1441us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789050074.832362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00010000:00010000:2.0:1789050075.306673:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050075.597867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.597911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.597978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.597999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.598036:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.598077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050075.598105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082432 00000100:00100000:2.0:1789050075.598115:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082432 00000100:00100000:2.0:1789050075.598180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082688 00000100:00100000:2.0:1789050075.598184:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082688 00000100:00100000:2.0:1789050075.598198:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082304 00000100:00100000:2.0:1789050075.598200:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082304 00000100:00100000:2.0:1789050075.598210:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082816 00000100:00100000:2.0:1789050075.598212:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082816 00000100:00100000:2.0:1789050075.598236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:2.0:1789050075.598248:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704082432:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.598329:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704082432:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 83us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.598337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:2.0:1789050075.598354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:2.0:1789050075.598361:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704082688:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.598385:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704082688:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.598390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:2.0:1789050075.598400:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:2.0:1789050075.598406:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704082304:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.598428:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704082304:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.598433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:2.0:1789050075.598443:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:2.0:1789050075.598458:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704082816:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.598483:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704082816:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.598489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:2.0:1789050075.598509:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082560 00000100:00100000:2.0:1789050075.598512:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082560 00000100:00100000:2.0:1789050075.598534:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:2.0:1789050075.598540:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704082560:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.598566:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704082560:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.598572:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00080000:2.0:1789050075.598592:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050075.598596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050075.600872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082176 00000100:00100000:3.0:1789050075.600887:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082176 00000100:00100000:3.0:1789050075.600974:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 332 00000100:00100000:3.0:1789050075.600985:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704082176:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050075.601061:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704082176:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 79us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050075.601068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 332 00010000:00010000:1.0:1789050076.329303:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050077.289688:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050077.289712:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714646784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050077.289790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050077.289997:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646784 00000100:00100000:3.0:1789050077.290203:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646784 00000100:00100000:1.0:1789050077.290333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789050077.290342:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714646784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050077.290374:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050077.290412:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714646784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050077.290419:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789050077.290815:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714646784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050077.359736:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050077.801354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714646912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050077.801450:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050077.801620:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714646912 00000100:00100000:0.0:1789050077.801631:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714646912 00000100:00100000:0.0:1789050077.801695:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789050077.801707:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714646912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050077.801750:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050077.801809:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714646912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050077.801816:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789050077.801915:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714646912:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050078.377296:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050078.822581:0:13681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789050079.337339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714647040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050079.337435:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.337442:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050079.337458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714647168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050079.337490:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.337548:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647040 00000100:00100000:1.0:1789050079.337559:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647040 00000100:00100000:1.0:1789050079.337645:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647168 00000100:00100000:1.0:1789050079.337674:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647168 00000100:00100000:1.0:1789050079.337702:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789050079.337711:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714647040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050079.337746:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789050079.338191:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050079.339434:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789050079.339459:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714647168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050079.339486:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050079.339567:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714647168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.339574:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789050079.339877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f6d80 x1875954714647168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.339903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714647168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050079.340001:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714647040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2289us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.340009:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789050079.341707:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983676d80 x1875954714647040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050079.341737:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714647040:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050079.401309:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050079.853812:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714647424:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.853840:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714647296:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.853906:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.853969:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.854023:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714647680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050079.854030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714647936:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.854069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050079.854084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.854114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714648320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.854125:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714648448:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.854166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.854191:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647680 00000100:00100000:3.0:1789050079.854210:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647680 00000100:00100000:3.0:1789050079.854283:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789050079.854295:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714647680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050079.854329:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050079.854458:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714648960:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.855476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714647808:0@lo:400:kworker.0 00000004:00080000:0.0:1789050079.855706:0:10097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302053766563ns, next at 303053763048ns, rc = 0 00000100:00100000:0.0:1789050079.855764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714647552:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.856895:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.856971:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050079.857000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647424 00000100:00100000:1.0:1789050079.857006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714648192:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.857010:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647424 00000100:00100000:2.0:1789050079.857068:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647808 00000100:00100000:2.0:1789050079.857072:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647808 00000100:00100000:3.0:1789050079.857095:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714647680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2795us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.857106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789050079.857118:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789050079.857121:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714647424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.857179:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647936 00000100:00100000:3.0:1789050079.857189:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647936 00000100:00100000:2.0:1789050079.857208:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714647424:12345-0@lo:400:kworker.0 Request processed in 80us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.857218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789050079.857245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789050079.857257:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714647808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.857263:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789050079.857277:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714647936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.857303:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714647808:12345-0@lo:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.857311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789050079.857342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050079.857364:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714647424:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.857369:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714648704:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.857395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.857425:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714647808:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.857448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648192 00000100:00100000:1.0:1789050079.857454:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648192 00000100:00100000:1.0:1789050079.857501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648704 00000100:00100000:1.0:1789050079.857505:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648704 00000100:00100000:1.0:1789050079.857523:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789050079.857530:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714648192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.857568:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714648192:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.857575:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789050079.857594:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789050079.857603:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714648704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.857613:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714647936:12345-0@lo:400:kworker.0 Request processed in 336us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.857623:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789050079.857640:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714648704:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.857655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789050079.857751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050079.857793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714648064:0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.857828:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.857862:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647552 00000100:00100000:3.0:1789050079.857867:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647552 00000100:00100000:3.0:1789050079.857888:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789050079.857894:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714647552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.857972:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714647552:12345-0@lo:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.857979:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789050079.858003:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648448 00000100:00100000:3.0:1789050079.858008:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648448 00000100:00100000:3.0:1789050079.858041:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648960 00000100:00100000:3.0:1789050079.858046:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648960 00000100:00100000:3.0:1789050079.858071:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050079.858079:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714648448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.858529:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714648448:12345-0@lo:400:kworker.0 Request processed in 59us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.858539:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050079.858556:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789050079.858564:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714648960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.858599:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714648960:12345-0@lo:400:kworker.0 Request processed in 37us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.858606:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789050079.858639:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050079.858644:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050079.858673:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.858703:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714648832:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.858731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789050079.858765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9835f6d80 x1875954714647680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.858788:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714647680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050079.858826:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648320 00000100:00100000:3.0:1789050079.858831:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648320 00000100:00100000:3.0:1789050079.858853:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648832 00000100:00100000:3.0:1789050079.858855:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648832 00000100:00100000:3.0:1789050079.858866:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789050079.858871:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714648320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.858905:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714648320:12345-0@lo:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.858913:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789050079.858972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789050079.858992:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714648832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.859031:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714648832:12345-0@lo:400:kworker.0 Request processed in 43us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050079.859039:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789050079.859076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982744000 x1875954714648320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.859087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714648320:0@lo:400:kworker.0 00010000:00080000:3.0:1789050079.859098:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c88e00 x1875954714648832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.859107:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714648832:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.859141:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714647936:0@lo:400:kworker.0 00010000:00080000:3.0:1789050079.859154:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c89880 x1875954714648448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.859163:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714648448:0@lo:400:kworker.0 00010000:00080000:3.0:1789050079.859174:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c89c00 x1875954714648960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.859183:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714648960:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.863406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714647296 00000100:00100000:2.0:1789050079.863423:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714647296 00000100:00100000:2.0:1789050079.863485:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789050079.863503:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714647296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.863677:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714647296:12345-0@lo:400:kworker.0 Request processed in 176us (9754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.863685:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000004:00080000:2.0:1789050079.865080:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789050079.865127:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789050079.865137:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789050079.865165:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865177:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865186:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865192:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050079.865206:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865215:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865232:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8baa9307b300) 00010000:00010000:2.0:1789050079.865236:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050079.865241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865248:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57590 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865283:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865292:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865298:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865303:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050079.865306:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865311:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865319:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8baa83dbb400) 00000100:00100000:3.0:1789050079.865455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714647296:0@lo:400:kworker.0 00010000:00010000:2.0:1789050079.865602:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050079.865609:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865616:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df575a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865642:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865649:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865655:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865667:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050079.865670:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865677:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865686:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8baa9307b300) 00010000:00010000:2.0:1789050079.865689:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050079.865692:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865697:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df5760e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865712:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865719:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865725:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865730:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050079.865733:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865739:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865758:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba9832fc200) 00010000:00010000:2.0:1789050079.865760:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050079.865764:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.865770:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df5762a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789050079.869047:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9837c9500 x1875954714648192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.869067:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714648192:0@lo:400:kworker.0 00010000:00080000:3.0:1789050079.869082:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c8a300 x1875954714648704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050079.869103:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714648704:0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.869298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648064 00000100:00100000:2.0:1789050079.869308:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648064 00000100:00100000:2.0:1789050079.869475:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789050079.869488:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714648064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050079.869589:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714648064:12345-0@lo:400:kworker.0 Request processed in 105us (11760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050079.869597:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789050079.870015:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714648576:0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.870087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050079.870131:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714649088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050079.870165:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050079.870215:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649088 00000100:00100000:0.0:1789050079.870222:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649088 00000100:00100000:0.0:1789050079.870275:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789050079.870288:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714649088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050079.870311:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050079.870357:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714649088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050079.870367:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789050079.870494:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c59f80 x1875954714649088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050079.870516:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714649088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050079.870554:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714647552:0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.870568:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714648064:0@lo:400:kworker.0 00000100:00080000:3.0:1789050079.870693:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050079.870712:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050079.870731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714649216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789050079.870750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714648576 00000100:00100000:1.0:1789050079.870757:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714648576 00000100:00100000:3.0:1789050079.870809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.870817:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789050079.870835:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714648576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.870885:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714648576:12345-0@lo:400:kworker.0 Request processed in 61us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.870893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1789050079.872978:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050079.873566:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649216 00000100:00100000:0.0:1789050079.873583:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649216 00000100:00100000:0.0:1789050079.874173:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789050079.874188:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714649216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789050079.874232:0:8434:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789050079.874284:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x18d3fb9032d681c0, atime: 0x18d3fb9032d681c0, ctime: 0x18d3fb9032d681c0, blocks: 0x0 00010000:00010000:0.0:1789050079.874295:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.874314:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1789050079.874319:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050079.874327:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.874350:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.874361:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.874370:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.874486:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050079.874867:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714649216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 682us (4060us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789050079.874877:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789050079.874978:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714648576:0@lo:400:kworker.0 00000004:00080000:1.0:1789050079.876346:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983c88000/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789050079.876360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714649216:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789050079.877391:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050079.877406:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.877422:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050079.877427:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.877439:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.877478:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.877486:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df57638 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.877508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050079.877510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050079.877512:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789050079.975325:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3b62f6d0 20000000:00000080:0.0:1789050079.975344:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba983784800 uarg=0000000000000000 20000000:01000000:0.0:1789050079.975391:0:13729:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789050079.975399:0:13729:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789050079.975404:0:13729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789050079.975914:0:13730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789050079.978132:0:13729:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789050079.986730:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789050079.986774:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789050079.986790:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789050079.986807:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789050079.986827:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986847:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986856:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986863:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986870:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986898:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986905:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986911:0:13729:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.986988:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987003:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987017:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649344:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050079.987119:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987126:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 12 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987135:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649472:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050079.987162:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987170:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 23 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987192:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649600:0@lo:104: 00000100:00100000:2.0:1789050079.987249:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050079.987291:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987299:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987306:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649728:0@lo:104: 00010000:00010000:2.0:1789050079.987330:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987338:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 23 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987346:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649856:0@lo:104: 00000100:00100000:1.0:1789050079.987362:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789050079.987369:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050079.987376:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 23 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050079.987379:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050079.987384:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649984:0@lo:104: 00000100:00100000:1.0:1789050079.987396:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.987419:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649600 00000100:00100000:2.0:1789050079.987422:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.987425:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649600 00000100:00100000:2.0:1789050079.987432:0:13729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789050079.987460:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649728 00000100:00100000:1.0:1789050079.987463:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649728 00000100:00100000:1.0:1789050079.987475:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649856 00000100:00100000:1.0:1789050079.987477:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649856 00000100:00100000:1.0:1789050079.987485:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714649984 00000100:00100000:1.0:1789050079.987487:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714649984 00000100:00100000:1.0:1789050079.987498:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789050079.987505:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa851a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+6:13729:x1875954714649600:12345-0@lo:104: 00010000:00010000:1.0:1789050079.987517:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987589:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050079.987600:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa851a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+6:13729:x1875954714649600:12345-0@lo:104: Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.987606:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789050079.987642:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050079.987648:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+5:13729:x1875954714649728:12345-0@lo:104: 00010000:00010000:1.0:1789050079.987655:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987690:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789050079.987694:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+5:13729:x1875954714649728:12345-0@lo:104: Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.987699:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050079.987709:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050079.987714:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:13729:x1875954714649856:12345-0@lo:104: 00010000:00010000:1.0:1789050079.987721:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987762:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789050079.987767:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+4:13729:x1875954714649856:12345-0@lo:104: Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.987773:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050079.987783:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050079.987789:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649600:0@lo:104: 00000100:00100000:1.0:1789050079.987789:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:13729:x1875954714649984:12345-0@lo:104: 00000100:00100000:2.0:1789050079.987797:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649728:0@lo:104: 00010000:00010000:1.0:1789050079.987797:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050079.987812:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649856:0@lo:104: 00000100:00100000:2.0:1789050079.987823:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649984:0@lo:104: 00010000:00010000:1.0:1789050079.987823:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789050079.987831:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8839590-fd25-4606-bad2-917c49937107+3:13729:x1875954714649984:12345-0@lo:104: Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.987837:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789050079.987856:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789050079.987862:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987869:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050079.987872:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987880:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050079.987888:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050079.987893:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050079.987913:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050079.987919:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.987925:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778600 already unused, calling callback (ffffffffc1287c20) 00010000:00010000:1.0:1789050079.987927:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050079.987928:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987934:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050079.987951:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050079.987958:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050079.987964:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050079.987968:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.987975:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2176200/0x3b8ec5973df574ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.987978:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.987984:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050079.987986:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050079.987997:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988002:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988003:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae778600/0x3b8ec5973df574e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988019:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050079.988022:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988022:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050079.988025:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988030:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988031:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050079.988034:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050079.988036:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988040:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050079.988041:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1789050079.988046:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050079.988051:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050079.988053:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988058:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050079.988062:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988063:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988068:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050079.988070:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df574d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050079.988073:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988078:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050079.988079:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae778000/0x3b8ec5973df574c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df574cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050079.988080:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050079.988082:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050079.988087:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050079.988090:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050079.988092:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050079.988093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050079.988098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714650112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050079.988101:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714650368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050079.988126:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.988171:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050079.988177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714650496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050079.988214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050079.988216:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650112 00000100:00100000:0.0:1789050079.988219:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650112 00010000:00010000:0.0:1789050079.988239:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 24 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050079.988246:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.988261:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050079.988266:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714650240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050079.988286:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050080.000118:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650496 00000100:00100000:0.0:1789050080.000136:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650496 00010000:00010000:0.0:1789050080.000187:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050080.000235:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650368 00000100:00100000:2.0:1789050080.000239:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650240 00000100:00100000:0.0:1789050080.000239:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650368 00000100:00100000:2.0:1789050080.000247:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650240 00010000:00010000:0.0:1789050080.000254:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 27 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050080.000275:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1789050080.000276:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 27 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050080.000287:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+27:3647:x1875954714650112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050080.000304:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1789050080.000304:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.000313:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 27 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050080.000315:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+27:3647:x1875954714650496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.000331:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 27 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.000350:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177c00/0x3b8ec5973df574f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df574ef expref: 27 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.000367:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.000445:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+26:3647:x1875954714650112:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (12318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.000469:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789050080.000489:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050080.000496:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+25:3645:x1875954714650368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.000505:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.000510:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.000519:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050080.000686:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050080.000691:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050080.001442:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050080.001455:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+25:3645:x1875954714650240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050080.001466:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050080.001472:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050080.002245:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714650112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050080.002864:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050080.002888:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177600/0x3b8ec5973df574cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df574c5 expref: 25 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050080.002904:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050080.002994:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714650496:12345-0@lo:103:ldlm_bl.0 Request processed in 2681us (14777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050080.003003:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050080.003037:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714650496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050080.006231:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649344:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050080.006248:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875954714649472:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050080.006287:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050080.006514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050080.006565:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083072 00000100:00100000:1.0:1789050080.006573:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083072 00010000:00010000:1.0:1789050080.006607:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 13 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050080.006640:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:1.0:1789050080.006648:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704083072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050080.006662:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050080.006666:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 13 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.006676:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 13 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.006692:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603600/0x3b8ec5973df574fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a13 expref: 13 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.006718:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050080.006766:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:2404:x1875954704083072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 118us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050080.006773:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789050080.007146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050080.011026:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082944 00000100:00100000:1.0:1789050080.011043:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082944 00010000:00010000:1.0:1789050080.011093:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050080.011255:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:1.0:1789050080.011268:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:2404:x1875954704082944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050080.011284:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050080.011290:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.011303:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.011321:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a1a expref: 12 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.011336:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050080.011374:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.011386:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2177000/0x3b8ec5973df574e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df574e1 expref: 23 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.011397:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050080.011406:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2404:x1875954704082944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 141us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050080.011413:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:3.0:1789050080.011456:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+22:3645:x1875954714650240:12345-0@lo:103:ldlm_bl.0 Request processed in 10005us (23169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050080.011463:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789050080.011538:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df574da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df574d3 expref: 22 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011555:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011564:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011669:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011678:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011685:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011691:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011714:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050080.011719:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011728:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011745:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.011756:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.011786:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+21:3645:x1875954714650368:12345-0@lo:103:ldlm_bl.0 Request processed in 11290us (23538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.011793:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050080.014738:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714650240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050080.014758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714650368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050080.015459:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.015486:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.015494:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031400/0x3b8ec5973df5763f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.425102:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050080.713891:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050080.713975:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083200 00000100:00100000:1.0:1789050080.713977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050080.713990:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083200 00000100:00100000:1.0:1789050080.714018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050080.714049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050080.714052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083456 00000100:00100000:3.0:1789050080.714059:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083456 00000100:00100000:2.0:1789050080.714067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 334 00000100:00100000:2.0:1789050080.714082:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2403:x1875954704083200:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050080.714097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050080.714131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050080.714178:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2403:x1875954704083200:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050080.714180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083712 00000100:00100000:3.0:1789050080.714186:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083712 00000100:00100000:2.0:1789050080.714200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 334 00000100:00100000:3.0:1789050080.714221:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083328 00000100:00100000:3.0:1789050080.714226:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083328 00000100:00100000:3.0:1789050080.714249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083840 00000100:00100000:3.0:1789050080.714271:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083840 00000100:00100000:3.0:1789050080.714297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:3.0:1789050080.714306:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083456:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050080.714333:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:3.0:1789050080.714346:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083456:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.714348:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704083712:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050080.714359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:3.0:1789050080.714380:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 221 00000100:00100000:3.0:1789050080.714388:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083328:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050080.714412:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704083712:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 69us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.714421:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:0.0:1789050080.714440:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:0.0:1789050080.714448:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704083840:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050080.714474:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704083840:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.714480:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:3.0:1789050080.714490:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083328:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050080.714498:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 221 00000100:00080000:3.0:1789050080.714526:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050080.714531:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050080.714542:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083584 00000100:00100000:3.0:1789050080.714546:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083584 00000100:00100000:3.0:1789050080.714598:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:3.0:1789050080.714606:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083584:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050080.714636:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704083584:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050080.714642:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00080000:2.0:1789050080.714712:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789050080.884162:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff2450190 20000000:00000080:3.0:1789050080.884184:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba983c1a800 uarg=0000000000000000 20000000:01000000:3.0:1789050080.884310:0:13778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789050080.884319:0:13778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789050080.884324:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1789050080.885771:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789050080.886357:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789050080.887182:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789050080.887233:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789050080.887356:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789050080.887373:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789050080.887470:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887491:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887504:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887510:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887517:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887524:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887530:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050080.887535:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887543:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887558:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887565:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.887582:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778600/0x3b8ec5973df57646 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.449333:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050081.479833:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050081.480005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083968 00000100:00100000:3.0:1789050081.480022:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083968 00000100:00100000:3.0:1789050081.480109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 335 00000100:00100000:3.0:1789050081.480122:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:6177:x1875954704083968:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050081.480148:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050081.480176:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603800/0x3b8ec5973df5764d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a67 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.480224:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603800/0x3b8ec5973df5764d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.480237:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603800/0x3b8ec5973df5764d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.480250:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603800, rc 0) 00000100:00100000:3.0:1789050081.480586:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704083968:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 464us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050081.480596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 335 00000100:00100000:1.0:1789050081.484053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050081.484201:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084096 00000100:00100000:2.0:1789050081.484214:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084096 00000100:00100000:2.0:1789050081.484292:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 336 00000100:00100000:2.0:1789050081.484305:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704084096:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.484729:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704084096:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 426us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.484739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 336 00000100:00100000:0.0:1789050081.490862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050081.491099:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084224 00000100:00100000:3.0:1789050081.491113:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084224 00000100:00100000:3.0:1789050081.491192:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 337 00000100:00100000:3.0:1789050081.491205:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704084224:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050081.491569:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704084224:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 365us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050081.491578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 337 00000100:00100000:0.0:1789050081.496469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050081.496598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084352 00000100:00100000:3.0:1789050081.496728:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084352 00000100:00100000:3.0:1789050081.496836:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 338 00000100:00100000:3.0:1789050081.496868:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:10811:x1875954704084352:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050081.497098:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:10811:x1875954704084352:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 233us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050081.497106:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 338 00000100:00100000:1.0:1789050081.510596:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050081.510813:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084480 00000100:00100000:2.0:1789050081.510826:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084480 00000100:00100000:2.0:1789050081.510901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 339 00000100:00100000:2.0:1789050081.510915:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:10811:x1875954704084480:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050081.511166:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:10811:x1875954704084480:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 254us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.511175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 339 00000100:00100000:2.0:1789050081.522910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050081.523635:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084608 00000100:00100000:3.0:1789050081.523651:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084608 00000100:00100000:3.0:1789050081.523785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 340 00000100:00100000:3.0:1789050081.523799:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:6177:x1875954704084608:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050081.523822:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050081.523847:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df57654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a6e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.523897:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df57654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a6e expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.523919:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df57654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a6e expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.523992:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603a00, rc 0) 00000100:00100000:3.0:1789050081.524068:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704084608:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 272us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050081.524075:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 340 00000100:00100000:1.0:1789050081.530278:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050081.534497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084736 00000100:00100000:2.0:1789050081.534521:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084736 00000100:00100000:2.0:1789050081.534821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 341 00000100:00100000:2.0:1789050081.534835:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704084736:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.535085:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704084736:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 253us (4832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.535094:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 341 00000100:00100000:1.0:1789050081.538123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050081.541532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084864 00000100:00100000:3.0:1789050081.541557:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084864 00000100:00100000:3.0:1789050081.541765:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 342 00000100:00100000:3.0:1789050081.541780:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704084864:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.542740:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:6177:x1875954704084864:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 954us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.542753:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 342 00000100:00100000:3.0:1789050081.552259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050081.553026:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084992 00000100:00100000:0.0:1789050081.553041:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084992 00000100:00100000:0.0:1789050081.553114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 343 00000100:00100000:0.0:1789050081.553126:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:10815:x1875954704084992:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050081.554883:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:10815:x1875954704084992:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 1742us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.554901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 343 00000100:00100000:1.0:1789050081.561443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050081.561592:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085120 00000100:00100000:2.0:1789050081.561605:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085120 00000100:00100000:2.0:1789050081.561683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 344 00000100:00100000:2.0:1789050081.561696:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:10815:x1875954704085120:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050081.562132:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:10815:x1875954704085120:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 437us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.562142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 344 10000000:01000000:2.0:1789050081.835323:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050081.835330:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab4394800 from 7 10000000:01000000:2.0:1789050081.835335:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050081.835560:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.835573:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.835586:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050081.835616:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.835866:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.836068:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.841105:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650624 00000100:00100000:0.0:1789050081.841124:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650624 00000100:00100000:0.0:1789050081.841296:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789050081.841308:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+20:6515:x1875954714650624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050081.841912:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050081.841933:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5765b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.842266:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5765b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.842279:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5765b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.842309:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778a00, rc 0) 00000100:00100000:0.0:1789050081.842893:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714650624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1584us (7024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.842902:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789050081.843287:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050081.843309:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.843856:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050081.843996:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.844043:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.844088:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.844411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650752 00000100:00100000:0.0:1789050081.844419:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650752 00000100:00100000:0.0:1789050081.844474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789050081.844490:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714650752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.844618:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714650752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.844626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789050081.844890:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.844924:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.845003:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.845028:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.845311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714650880 00000100:00100000:0.0:1789050081.845317:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714650880 00000100:00100000:0.0:1789050081.845351:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789050081.845360:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714650880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.845447:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714650880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.845454:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789050081.850245:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714650880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.850759:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13791:1875954714651008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.850901:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050081.851061:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651008 00000100:00100000:0.0:1789050081.851068:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651008 00000100:00100000:2.0:1789050081.851166:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.851235:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789050081.851245:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:13791:x1875954714651008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050081.851410:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+21:13791:x1875954714651008:12345-0@lo:502:llog_process_th.0 Request processed in 159us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.851418:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789050081.853180:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13791:1875954714651008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050081.853238:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050081.853252:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.853255:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050081.853263:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baab4394800 00000020:00000080:2.0:1789050081.853266:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050081.853358:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050081.853362:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.853364:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050081.853367:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050081.853380:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.853381:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789050081.853385:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baab4394800 00000020:00000080:2.0:1789050081.853388:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789050081.853467:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13791:1875954714651136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.853534:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.855961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651136 00000100:00100000:1.0:1789050081.855975:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651136 00000100:00100000:1.0:1789050081.856026:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789050081.856036:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:13791:x1875954714651136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050081.856211:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:13791:x1875954714651136:12345-0@lo:502:llog_process_th.0 Request processed in 176us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050081.856226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789050081.859712:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.859757:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13791:1875954714651136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050081.859797:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050081.859805:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.859808:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789050081.859813:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789050081.866239:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789050081.866285:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050081.866298:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.866322:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050081.866335:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050081.866338:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac621000 from 7 10000000:01000000:1.0:1789050081.866341:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050081.866390:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.866407:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.866418:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050081.866444:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050081.866744:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.866792:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.867290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651264 00000100:00100000:2.0:1789050081.867298:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651264 00000100:00100000:2.0:1789050081.867354:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789050081.867363:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+21:6515:x1875954714651264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050081.867388:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050081.867408:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa80030200/0x3b8ec5973df57670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57669 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.867432:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa80030200/0x3b8ec5973df57670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57669 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.867443:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa80030200/0x3b8ec5973df57670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57669 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.867471:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030200, rc 0) 00000100:00100000:2.0:1789050081.867778:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 415us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.867786:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789050081.868781:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050081.868809:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.868821:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050081.868917:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050081.869005:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.869040:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.869288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651392 00000100:00100000:2.0:1789050081.869296:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651392 00000100:00100000:2.0:1789050081.869353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789050081.869364:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.869518:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.869526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789050081.869772:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.869810:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.869857:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050081.869886:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.870597:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651520 00000100:00100000:2.0:1789050081.870605:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651520 00000100:00100000:2.0:1789050081.870659:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789050081.870668:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.870787:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.870794:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789050081.870845:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.871083:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13794:1875954714651648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.871121:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.871140:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651648 00000100:00100000:2.0:1789050081.871155:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651648 00000100:00100000:2.0:1789050081.871173:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789050081.871198:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:13794:x1875954714651648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.871266:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:13794:x1875954714651648:12345-0@lo:502:llog_process_th.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.871272:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789050081.871308:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.871333:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13794:1875954714651648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050081.871355:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050081.871363:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.871365:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050081.871382:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baaac621000 00000020:00000080:2.0:1789050081.871385:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050081.871446:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050081.872035:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050081.872039:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789050081.872046:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050081.872049:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050081.872051:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789050081.872055:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baaac621000 00000020:00000080:1.0:1789050081.872057:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789050081.872110:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13794:1875954714651776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050081.872168:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.872209:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.872313:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651776 00000100:00100000:0.0:1789050081.872321:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651776 00000100:00100000:0.0:1789050081.872366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789050081.872375:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:13794:x1875954714651776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050081.872470:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+22:13794:x1875954714651776:12345-0@lo:502:llog_process_th.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.872478:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789050081.872576:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13794:1875954714651776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050081.872598:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050081.872603:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050081.872605:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789050081.872609:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789050081.872859:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789050081.872881:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050081.872892:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.872903:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050081.872914:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050081.872916:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baab0ea0000 from 7 10000000:01000000:0.0:1789050081.872919:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050081.872982:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.872990:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.873000:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050081.873024:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.873058:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050081.873079:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789050081.873354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714651904 00000100:00100000:1.0:1789050081.873361:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714651904 00000100:00100000:1.0:1789050081.873396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789050081.873403:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+22:6515:x1875954714651904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050081.873413:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050081.873425:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2043400/0x3b8ec5973df5767e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57677 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.873446:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2043400/0x3b8ec5973df5767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57677 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.873464:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2043400/0x3b8ec5973df5767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57677 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.873472:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043400, rc 0) 00000100:00100000:1.0:1789050081.873510:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714651904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050081.873517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789050081.873551:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714651904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050081.873564:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.873573:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050081.873743:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050081.873772:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.873794:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.873836:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652032 00000100:00100000:0.0:1789050081.873840:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652032 00000100:00100000:0.0:1789050081.873868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789050081.873874:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714652032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.874016:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714652032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.874023:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789050081.874072:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.874101:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.874140:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.874240:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250ea80 going to sleep for 11 seconds 00000040:00080000:3.0:1789050081.883533:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789050081.885234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652160 00000100:00100000:1.0:1789050081.885250:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652160 00000100:00100000:1.0:1789050081.885313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789050081.885326:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714652160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050081.885636:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714652160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (11495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050081.885645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789050081.885798:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050081.887437:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13796:1875954714652288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050081.887592:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050081.887637:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.887923:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652288 00000100:00100000:2.0:1789050081.887931:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652288 00000100:00100000:2.0:1789050081.888000:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789050081.888164:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:13796:x1875954714652288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.888317:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+23:13796:x1875954714652288:12345-0@lo:502:llog_process_th.0 Request processed in 156us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.888325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789050081.888608:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13796:1875954714652288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789050081.888641:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050081.888650:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050081.888652:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050081.888658:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baab0ea0000 00000020:00000080:3.0:1789050081.888660:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050081.888717:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050081.888720:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050081.888722:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050081.888724:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050081.888727:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050081.888728:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789050081.888732:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baab0ea0000 00000020:00000080:3.0:1789050081.888734:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789050081.888773:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13796:1875954714652416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050081.888814:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050081.888849:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9832926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050081.889871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652416 00000100:00100000:1.0:1789050081.889882:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652416 00000100:00100000:1.0:1789050081.889928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789050081.889954:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:13796:x1875954714652416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050081.890240:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+23:13796:x1875954714652416:12345-0@lo:502:llog_process_th.0 Request processed in 302us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050081.890248:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789050081.890299:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13796:1875954714652416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050081.890324:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050081.890330:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050081.890332:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789050081.890337:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789050081.891271:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789050081.891299:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050081.891310:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.891329:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050081.891340:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050081.891342:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baaac606800 from 7 10000000:01000000:2.0:1789050081.891345:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050081.891376:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.891384:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050081.891394:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050081.891414:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.892201:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.892289:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050081.900122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652544 00000100:00100000:1.0:1789050081.900139:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652544 00000100:00100000:1.0:1789050081.900221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789050081.900231:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+23:6515:x1875954714652544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050081.900250:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050081.900270:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2042800/0x3b8ec5973df5768c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df57685 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.900299:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2042800/0x3b8ec5973df5768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df57685 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.900310:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2042800/0x3b8ec5973df5768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df57685 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050081.900336:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042800, rc 0) 00000100:00100000:1.0:1789050081.900425:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714652544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (8967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050081.900432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789050081.900605:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050081.900628:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050081.900656:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050081.900738:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.900788:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050081.900827:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050081.901078:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652672 00000100:00100000:2.0:1789050081.901084:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652672 00000100:00100000:2.0:1789050081.901119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789050081.901127:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714652672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.901247:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714652672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050081.901254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789050081.901288:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.901317:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050081.901361:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.901391:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.902922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652800 00000100:00100000:0.0:1789050081.902932:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652800 00000100:00100000:0.0:1789050081.903133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789050081.903143:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714652800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050081.903364:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:6515:x1875954714652800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.903373:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789050081.903745:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8839590-fd25-4606-bad2-917c49937107:6515:1875954714652800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050081.909420:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050081.910667:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13799:1875954714652928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.910751:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.910790:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.910863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714652928 00000100:00100000:0.0:1789050081.910871:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714652928 00000100:00100000:0.0:1789050081.910921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789050081.910932:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:13799:x1875954714652928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050081.911083:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:13799:x1875954714652928:12345-0@lo:502:llog_process_th.0 Request processed in 151us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.911091:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789050081.911472:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13799:1875954714652928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050081.911502:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050081.911512:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.911514:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050081.911521:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baaac606800 00000020:00000080:2.0:1789050081.911524:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050081.911588:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050081.911593:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.911594:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050081.911597:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050081.911599:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.911600:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789050081.911603:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baaac606800 00000020:00000080:2.0:1789050081.911605:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789050081.911642:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13799:1875954714653056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050081.911681:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050081.911695:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050081.912866:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653056 00000100:00100000:0.0:1789050081.912876:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653056 00000100:00100000:0.0:1789050081.912933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789050081.912964:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:13799:x1875954714653056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050081.913112:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:13799:x1875954714653056:12345-0@lo:502:llog_process_th.0 Request processed in 150us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050081.913120:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789050081.913812:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8839590-fd25-4606-bad2-917c49937107:13799:1875954714653056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050081.913846:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050081.913853:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050081.913861:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789050081.913865:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789050081.914156:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789050081.914189:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050081.914200:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050081.914212:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050082.409582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714653184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050082.409676:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050082.412429:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653184 00000100:00100000:0.0:1789050082.412445:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653184 00000100:00100000:0.0:1789050082.412595:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789050082.412606:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714653184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789050082.412647:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789050082.412739:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714653184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050082.412746:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789050082.412849:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714653184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050082.474508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050082.921305:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050082.921384:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050082.921472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653312 00000100:00100000:3.0:1789050082.921480:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653312 00000100:00100000:3.0:1789050082.921525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789050082.921534:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714653312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050082.921572:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050082.921622:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714653312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050082.921629:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789050082.921681:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653312:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789050082.921702:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789050082.922265:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789050083.497233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050084.457345:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050084.457368:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050084.457437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050084.457550:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653440 00000100:00100000:3.0:1789050084.457559:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653440 00000100:00100000:3.0:1789050084.457633:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789050084.457644:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714653440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050084.457675:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050084.457720:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714653440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050084.457728:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789050084.457964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714653568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050084.457994:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050084.458194:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653568 00000100:00100000:2.0:1789050084.458199:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653568 00000100:00100000:2.0:1789050084.458235:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789050084.458243:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714653568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050084.458256:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050084.458289:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714653568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050084.458301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789050084.458379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983677800 x1875954714653568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050084.458415:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714653568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789050084.458567:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050084.458596:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983495c00 x1875954714653440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050084.458609:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789050084.521135:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050084.969718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714653696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050084.969797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050084.969892:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653696 00000100:00100000:0.0:1789050084.969900:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653696 00000100:00100000:0.0:1789050084.969975:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789050084.969986:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714653696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050084.970017:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050084.970063:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714653696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050084.970071:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789050084.970091:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050084.970340:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714653696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050084.970676:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050084.970731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050084.970851:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653824 00000100:00100000:3.0:1789050084.970857:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653824 00000100:00100000:3.0:1789050084.970901:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789050084.970909:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714653824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050084.970922:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050084.970984:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714653824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050084.970990:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789050084.971027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714653824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789050084.971205:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050084.972728:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714654208:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.972741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714653952:0@lo:400:kworker.0 00000100:00100000:3.0:1789050084.972828:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714654336:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.972838:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714654080:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.972963:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050084.972998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714654464:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.973024:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050084.973043:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714654976:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.973065:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050084.973099:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654464 00000100:00100000:1.0:1789050084.973107:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654464 00000100:00100000:1.0:1789050084.973150:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789050084.974300:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714654464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.974396:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714654464:12345-0@lo:400:kworker.0 Request processed in 1238us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050084.974405:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789050084.974448:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654976 00000100:00100000:1.0:1789050084.974454:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654976 00000100:00100000:1.0:1789050084.974493:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789050084.974501:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.974534:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714654976:12345-0@lo:400:kworker.0 Request processed in 34us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050084.974558:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789050084.974601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714654464:0@lo:400:kworker.0 00010000:00080000:1.0:1789050084.974615:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983676d80 x1875954714654976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050084.974630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714654976:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.974675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714653952 00000100:00100000:1.0:1789050084.974679:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714653952 00000100:00100000:1.0:1789050084.974709:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789050084.974716:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714653952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.974752:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714653952:12345-0@lo:400:kworker.0 Request processed in 37us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050084.974758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789050084.974790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714653952:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.977817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050084.977907:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714654592:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.977972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050084.977996:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714655104:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978018:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050084.978074:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654080 00000100:00100000:0.0:1789050084.978082:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654080 00000100:00100000:0.0:1789050084.978143:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654592 00000100:00100000:0.0:1789050084.978146:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654592 00000100:00100000:0.0:1789050084.978180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655104 00000100:00100000:0.0:1789050084.978183:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655104 00000100:00100000:0.0:1789050084.978202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789050084.978211:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714654080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978268:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714654080:12345-0@lo:400:kworker.0 Request processed in 58us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050084.978275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789050084.978292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789050084.978298:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714654592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978326:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714654592:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050084.978332:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789050084.978343:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789050084.978349:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978374:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714655104:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050084.978380:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1789050084.978401:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050084.978430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714654080:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978451:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714654592:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.978461:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714655104:0@lo:400:kworker.0 00000100:00100000:2.0:1789050084.983139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050084.983213:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714654720:0@lo:400:kworker.0 00000100:00100000:2.0:1789050084.983272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050084.983303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714655232:0@lo:400:kworker.0 00000100:00100000:2.0:1789050084.983325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050084.983370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654720 00000100:00100000:2.0:1789050084.983378:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654720 00000100:00100000:2.0:1789050084.983428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655232 00000100:00100000:2.0:1789050084.983431:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655232 00000100:00100000:2.0:1789050084.983456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789050084.983465:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714654720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050084.983521:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714654720:12345-0@lo:400:kworker.0 Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050084.983527:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789050084.983543:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789050084.983566:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714655232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050084.983597:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714655232:12345-0@lo:400:kworker.0 Request processed in 34us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050084.983603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1789050084.983786:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050084.984136:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654208 00000100:00100000:0.0:1789050084.984143:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654208 00000100:00100000:0.0:1789050084.984187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789050084.984196:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714654208:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789050084.984471:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983676300 x1875954714654720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050084.984486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714654720:0@lo:400:kworker.0 00000100:00100000:3.0:1789050084.991966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050084.992032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714654848:0@lo:400:kworker.0 00000100:00100000:3.0:1789050084.992083:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050084.992151:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654848 00000100:00100000:3.0:1789050084.992159:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654848 00000100:00100000:3.0:1789050084.992219:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789050084.992229:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714654848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050084.992285:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714654848:12345-0@lo:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050084.992291:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789050084.992336:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983675f80 x1875954714654848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050084.992349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714654848:0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.992451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714654336 00000100:00100000:1.0:1789050084.992455:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714654336 00000100:00100000:1.0:1789050084.992496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789050084.992505:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050084.992546:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714654336:12345-0@lo:400:kworker.0 Request processed in 43us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050084.992551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789050084.994007:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714654336:0@lo:400:kworker.0 00000100:00100000:0.0:1789050084.995313:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714654208:12345-0@lo:400:kworker.0 Request processed in 11113us (12176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050084.995325:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1789050085.002145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983677800 x1875954714655232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050085.002172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714655232:0@lo:400:kworker.0 00000100:00100000:2.0:1789050085.002207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714654208:0@lo:400:kworker.0 00010000:00010000:0.0:1789050085.545641:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050085.835753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050085.835810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050085.835845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050085.835879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050085.835923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050085.835969:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085632 00000100:00100000:1.0:1789050085.835984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050085.835988:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085632 00000100:00100000:3.0:1789050085.836008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085376 00000100:00100000:3.0:1789050085.836013:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085376 00000100:00100000:1.0:1789050085.836014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085248 00000100:00100000:1.0:1789050085.836021:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085248 00000100:00100000:3.0:1789050085.836051:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085888 00000100:00100000:3.0:1789050085.836056:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085888 00000100:00100000:0.0:1789050085.836057:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:2.0:1789050085.836063:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085504 00000100:00100000:0.0:1789050085.836070:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085632:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050085.836071:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085504 00000100:00100000:2.0:1789050085.836099:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085760 00000100:00100000:2.0:1789050085.836104:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085760 00000100:00100000:1.0:1789050085.836125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 366 00000100:00100000:2.0:1789050085.836135:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 229 00000100:00100000:1.0:1789050085.836139:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704085248:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050085.836150:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085632:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 82us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050085.836151:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085376:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050085.836164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:0.0:1789050085.836171:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789050085.836176:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085504:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050085.836187:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704085248:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050085.836196:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 366 00000100:00080000:0.0:1789050085.836207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050085.836213:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050085.836218:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085376:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00080000:0.0:1789050085.836218:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050085.836220:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704085504:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050085.836229:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789050085.836236:0:6520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789050085.836251:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 229 00000100:00100000:0.0:1789050085.836251:0:6519:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789050085.836261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:0.0:1789050085.836338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:0.0:1789050085.836346:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704085760:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050085.836374:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704085760:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050085.836386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:0.0:1789050085.836401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 232 00000100:00100000:0.0:1789050085.836407:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704085888:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050085.836433:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704085888:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050085.836439:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 232 00000001:00080000:0.0:1789050086.001262:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1789050086.569115:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050087.529336:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714655360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050087.529429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050087.529556:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655360 00000100:00100000:2.0:1789050087.529566:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655360 00000100:00100000:2.0:1789050087.529622:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789050087.529632:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714655360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050087.529668:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789050087.538526:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714655360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8886us (9088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050087.538543:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789050087.538622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714655360:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050087.593221:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050088.041896:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050088.041929:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714655488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050088.042030:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050088.042185:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655488 00000100:00100000:0.0:1789050088.042193:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655488 00000100:00100000:0.0:1789050088.042249:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789050088.042260:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714655488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050088.042297:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050088.042360:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714655488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050088.042368:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789050088.042455:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714655488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050088.617260:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050089.577301:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050089.577336:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714655616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050089.577410:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050089.577580:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655616 00000100:00100000:3.0:1789050089.577588:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655616 00000100:00100000:3.0:1789050089.577652:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789050089.577663:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714655616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050089.577693:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050089.577763:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714655616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050089.577770:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1789050089.577830:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaae794a80 x1875954714655616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050089.577846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714655616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789050089.578096:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050089.578435:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714655744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050089.578473:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050089.578547:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655744 00000100:00100000:0.0:1789050089.578553:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655744 00000100:00100000:0.0:1789050089.578600:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789050089.578608:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714655744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050089.578622:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789050089.578682:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050089.583202:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714655744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4584us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050089.583217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789050089.583353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983677800 x1875954714655744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050089.583379:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714655744:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789050089.641093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050090.089247:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714656000:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714656512:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714657024:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089512:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789050090.089518:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714655872:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089541:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089558:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714656384:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089577:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089590:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714656896:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089610:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089623:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714657408:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.089641:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.089672:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656000 00000100:00100000:0.0:1789050090.089679:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656000 00000100:00100000:0.0:1789050090.089734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656512 00000100:00100000:0.0:1789050090.089738:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656512 00000100:00100000:2.0:1789050090.089845:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656384 00000100:00100000:2.0:1789050090.089850:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656384 00000100:00100000:2.0:1789050090.089885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789050090.089895:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714656384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.089971:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714656384:12345-0@lo:400:kworker.0 Request processed in 77us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.089978:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789050090.090019:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714656384:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.090059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656896 00000100:00100000:2.0:1789050090.090063:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656896 00000100:00100000:2.0:1789050090.090085:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657408 00000100:00100000:2.0:1789050090.090088:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657408 00000100:00100000:2.0:1789050090.090113:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789050090.090119:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714656896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.090166:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714656896:12345-0@lo:400:kworker.0 Request processed in 47us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.090173:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789050090.090187:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789050090.090193:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714657408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.090221:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714657408:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.090226:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789050090.090247:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657024 00000100:00100000:2.0:1789050090.090251:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657024 00000100:00100000:3.0:1789050090.090263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789050090.090334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714655872 00000100:00100000:1.0:1789050090.090338:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714655872 00000100:00100000:1.0:1789050090.090365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789050090.090371:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714655872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090403:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714655872:12345-0@lo:400:kworker.0 Request processed in 32us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050090.090409:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:1.0:1789050090.090432:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050090.090508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714656256:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090545:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.090570:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714656768:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.090606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714657280:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.090643:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789050090.090649:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714656128:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090669:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.090684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714656640:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090703:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.090717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714657152:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.090735:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050090.090900:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656256 00000100:00100000:0.0:1789050090.090904:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656256 00000100:00100000:1.0:1789050090.090926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714657664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050090.090973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050090.091003:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656128 00000100:00100000:1.0:1789050090.091006:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656128 00000100:00100000:2.0:1789050090.092381:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656640 00000100:00100000:2.0:1789050090.092392:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656640 00000100:00100000:2.0:1789050090.092411:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657152 00000100:00100000:2.0:1789050090.092414:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657152 00000100:00100000:2.0:1789050090.092429:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789050090.092438:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714656512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.092504:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714656512:12345-0@lo:400:kworker.0 Request processed in 68us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.092511:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789050090.092527:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789050090.092533:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714657024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.092558:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714657024:12345-0@lo:400:kworker.0 Request processed in 26us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.092564:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789050090.092575:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789050090.092581:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714656640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.092620:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714656640:12345-0@lo:400:kworker.0 Request processed in 40us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.092626:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789050090.092637:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789050090.092643:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714657152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.092815:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714657152:12345-0@lo:400:kworker.0 Request processed in 171us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.092822:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789050090.092860:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714657536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050090.092894:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050090.092958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714655872:0@lo:400:kworker.0 00010000:00080000:2.0:1789050090.092976:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce2300 x1875954714656896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050090.092987:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714656896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.092998:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789050090.093003:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983c88000, transno 4294967301 00000100:00100000:2.0:1789050090.093014:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714657408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.093024:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714656512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.093033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714657024:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.093177:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657664 00000100:00100000:2.0:1789050090.093182:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657664 00000100:00100000:2.0:1789050090.093209:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657536 00000100:00100000:2.0:1789050090.093212:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657536 00000100:00100000:3.0:1789050090.093345:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714656000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050090.093394:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714656000:12345-0@lo:400:kworker.0 Request processed in 3123us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.093401:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789050090.093429:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789050090.093438:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714657664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050090.093462:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050090.093465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789050090.093475:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714656256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050090.093501:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714657664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.093507:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789050090.093524:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714656256:12345-0@lo:400:kworker.0 Request processed in 49us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050090.093532:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789050090.093550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714656000:0@lo:400:kworker.0 00000100:00080000:0.0:1789050090.093558:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050090.093570:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050090.093572:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050090.093604:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714656768 00000100:00100000:0.0:1789050090.093609:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714656768 00010000:00080000:3.0:1789050090.093627:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1880 x1875954714656640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050090.093637:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657280 00000100:00100000:3.0:1789050090.093638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714656640:0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.093642:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657280 00010000:00080000:3.0:1789050090.093663:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1c00 x1875954714657152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050090.093672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714657152:0@lo:400:kworker.0 00000100:00100000:3.0:1789050090.093686:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9836a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714657664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050090.093696:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714656256:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.093701:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789050090.093711:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875954714657536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050090.093723:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050090.093741:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789050090.093749:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050090.093784:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714656768:12345-0@lo:400:kworker.0 Request processed in 36us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.093791:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789050090.093812:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00010000:00080000:3.0:1789050090.093819:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1f80 x1875954714656768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050090.093824:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714656128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050090.093837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714656768:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.093880:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714656128:12345-0@lo:400:kworker.0 Request processed in 58us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.093886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714656128:0@lo:400:kworker.0 00000100:00100000:1.0:1789050090.093890:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789050090.095902:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789050090.095923:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875954714657280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050090.096018:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875954714657280:12345-0@lo:400:kworker.0 Request processed in 105us (5389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050090.096025:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789050090.096170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714657280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050090.096450:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714657536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2739us (3553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.096459:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789050090.096520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714657536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789050090.666086:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050090.952723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050090.953323:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050090.953438:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086016 00000100:00100000:1.0:1789050090.953453:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086016 00000100:00100000:1.0:1789050090.953534:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 368 00000100:00100000:1.0:1789050090.953545:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704086016:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050090.953635:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704086016:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050090.953657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 368 00000100:00100000:3.0:1789050090.954902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050090.955063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050090.955131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086144 00000100:00100000:3.0:1789050090.955142:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086144 00000100:00100000:3.0:1789050090.955270:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086656 00000100:00100000:3.0:1789050090.955274:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086656 00000100:00100000:3.0:1789050090.955302:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:3.0:1789050090.955313:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704086144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050090.955405:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704086144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 93us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.955414:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:3.0:1789050090.955438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:3.0:1789050090.955444:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704086656:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050090.955472:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704086656:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050090.955479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00080000:3.0:1789050090.955496:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050090.955502:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050090.955982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050090.956007:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050090.956025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086272 00000100:00100000:3.0:1789050090.956030:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086272 00000100:00100000:3.0:1789050090.956063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086528 00000100:00100000:3.0:1789050090.956066:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086528 00000100:00100000:3.0:1789050090.956084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:3.0:1789050090.956090:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704086272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050090.956146:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704086272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.956684:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086400 00000100:00100000:2.0:1789050090.956692:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086400 00000100:00100000:2.0:1789050090.956741:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:2.0:1789050090.956751:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704086400:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050090.956787:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704086400:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.956807:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00080000:2.0:1789050090.956850:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050090.956855:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050090.956858:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050090.956880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:2.0:1789050090.956889:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704086528:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050090.956918:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704086528:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050090.956924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:3.0:1789050090.957301:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 241 00010000:00010000:0.0:1789050091.689500:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050092.139200:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789050092.140087:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050092.649333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714657792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050092.649468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050092.649908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657792 00000100:00100000:1.0:1789050092.649919:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657792 00000100:00100000:1.0:1789050092.650017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789050092.650029:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714657792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050092.650376:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050092.650457:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714657792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 430us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050092.650465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789050092.650585:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714657792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050092.713782:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050093.162707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050093.162738:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714657920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050093.162978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050093.164180:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714657920 00000100:00100000:1.0:1789050093.164198:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714657920 00000100:00100000:1.0:1789050093.164332:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789050093.164345:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714657920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050093.164394:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789050093.164490:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714657920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050093.164498:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789050093.164657:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714657920:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050093.737519:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050094.697420:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050094.697454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050094.697544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050094.697666:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714658176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050094.697698:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658048 00000100:00100000:3.0:1789050094.697705:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050094.697711:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658048 00000100:00100000:0.0:1789050094.697801:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658176 00000100:00100000:0.0:1789050094.697806:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658176 00000100:00100000:2.0:1789050094.697849:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789050094.697864:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714658048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050094.697903:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050094.697987:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714658048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050094.697995:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1789050094.699107:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba982448e00 x1875954714658048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050094.699137:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714658048:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789050094.699669:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050094.703800:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789050094.703819:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714658176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050094.703853:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050094.704591:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714658176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 775us (6882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050094.704600:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789050094.705220:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983676d80 x1875954714658176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050094.705320:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714658176:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050094.762278:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050095.209893:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050095.209920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714658304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050095.210027:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050095.210116:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658304 00000100:00100000:3.0:1789050095.210126:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658304 00000100:00100000:3.0:1789050095.210204:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789050095.210215:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714658304:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789050095.210710:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050095.211556:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714658560:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.211652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659072:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.211745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211761:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.211788:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789050095.211818:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714658432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050095.211844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714658944:0@lo:400:kworker.0 00002000:00000024:3.0:1789050095.211879:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050095.211900:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211923:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714659456:0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.211961:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714658304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1746us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050095.211975:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789050095.211975:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.211997:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.212010:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658432 00000100:00100000:0.0:1789050095.212021:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050095.212030:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658432 00000100:00100000:0.0:1789050095.212057:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659584 00000100:00100000:0.0:1789050095.212062:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659584 00000100:00100000:3.0:1789050095.212081:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050095.212103:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714658432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050095.212120:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659456 00000100:00100000:0.0:1789050095.212124:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659456 00002000:00000024:3.0:1789050095.212130:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050095.212141:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659968 00000100:00100000:0.0:1789050095.212145:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659968 00000100:00100000:0.0:1789050095.212164:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789050095.212177:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.212184:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714658432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050095.212191:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789050095.212220:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659584:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.212228:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789050095.212250:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658944 00000100:00100000:3.0:1789050095.212256:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658944 00000100:00100000:0.0:1789050095.212260:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050095.212276:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714659456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.212290:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789050095.212300:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714658944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212314:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714659456:12345-0@lo:400:kworker.0 Request processed in 40us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.212321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050095.212339:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050095.212346:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212376:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659968:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.212381:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050095.212439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714658432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050095.212451:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714658944:0@lo:400:kworker.0 00010000:00080000:0.0:1789050095.212463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c88000 x1875954714659456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050095.212473:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714659456:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659968:0@lo:400:kworker.0 00010000:00080000:0.0:1789050095.212503:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce2680 x1875954714659584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050095.212512:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212558:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714658816:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212583:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.212602:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714659328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.212645:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714659840:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212664:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.212685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789050095.212691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714658688:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.212727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714659200:0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050095.212757:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714659712:0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.212760:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659072 00000100:00100000:1.0:1789050095.212766:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659072 00000100:00100000:0.0:1789050095.212780:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050095.212807:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658816 00000100:00100000:0.0:1789050095.212809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659328 00000100:00100000:0.0:1789050095.212813:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659328 00000100:00100000:1.0:1789050095.212820:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658816 00000100:00100000:0.0:1789050095.212836:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659840 00000100:00100000:0.0:1789050095.212841:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659840 00000100:00100000:1.0:1789050095.212848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789050095.212858:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658688 00000100:00100000:0.0:1789050095.212865:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658688 00000100:00100000:0.0:1789050095.212880:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659200 00000100:00100000:0.0:1789050095.212882:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659200 00000100:00100000:0.0:1789050095.212899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714659712 00000100:00100000:0.0:1789050095.212901:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714659712 00000100:00100000:1.0:1789050095.212918:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714659072:12345-0@lo:400:kworker.0 Request processed in 61us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.212919:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789050095.212933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789050095.212934:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714659328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.212973:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789050095.212982:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714658816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.212998:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714659328:12345-0@lo:400:kworker.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.213005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789050095.213023:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714658816:12345-0@lo:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.213024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789050095.213035:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789050095.213037:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714659840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.213079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714658304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050095.213128:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714658560 00000100:00100000:2.0:1789050095.213134:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714658560 00000100:00100000:2.0:1789050095.213171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789050095.213178:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714658560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.214725:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714658944:12345-0@lo:400:kworker.0 Request processed in 2415us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050095.214740:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789050095.214788:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789050095.214804:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714658688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.217651:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714659840:12345-0@lo:400:kworker.0 Request processed in 4600us (4967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.217699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789050095.218025:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714659072:0@lo:400:kworker.0 00000100:00080000:1.0:1789050095.218081:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050095.218087:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789050095.218103:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050095.218259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714658816:0@lo:400:kworker.0 00010000:00080000:1.0:1789050095.218286:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983675f80 x1875954714659328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050095.218299:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714659328:0@lo:400:kworker.0 00010000:00080000:1.0:1789050095.218313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1f80 x1875954714659840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050095.218322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714659840:0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.218387:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789050095.218414:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714659200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050095.218633:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789050095.218649:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714659712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.218650:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714659200:12345-0@lo:400:kworker.0 Request processed in 237us (5897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050095.218663:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789050095.218696:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714659712:12345-0@lo:400:kworker.0 Request processed in 55us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050095.218703:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789050095.218710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714659200:0@lo:400:kworker.0 00000100:00100000:1.0:1789050095.218724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714659712:0@lo:400:kworker.0 00000100:00100000:2.0:1789050095.222567:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714658560:12345-0@lo:400:kworker.0 Request processed in 9378us (10903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050095.222587:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789050095.222710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714658688:0@lo:400:kworker.0 00000100:00100000:3.0:1789050095.222771:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714658688:12345-0@lo:400:kworker.0 Request processed in 7699us (9781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050095.222783:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789050095.222982:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714658560:0@lo:400:kworker.0 00010000:00010000:1.0:1789050095.785222:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050096.078033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050096.078075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050096.078122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050096.078172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086784 00000100:00100000:1.0:1789050096.078178:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087040 00000100:00100000:1.0:1789050096.078194:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087040 00000100:00100000:2.0:1789050096.078210:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086784 00000100:00100000:0.0:1789050096.078271:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086912 00000100:00100000:0.0:1789050096.078279:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086912 00000100:00100000:1.0:1789050096.078309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 249 00000100:00100000:2.0:1789050096.078316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 370 00000100:00100000:2.0:1789050096.078335:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704086784:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:3.0:1789050096.078342:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050096.078349:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050096.078433:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704086784:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 105us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050096.078441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 370 00000100:00100000:1.0:1789050096.078617:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704087040:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050096.078686:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704087040:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 79us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050096.081916:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:1.0:1789050096.081933:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 249 00000100:00100000:0.0:1789050096.081959:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704086912:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050096.082068:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704086912:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 140us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050096.082077:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:3.0:1789050096.084815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050096.084971:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050096.092666:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087296 00000100:00100000:0.0:1789050096.092680:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087296 00000100:00100000:0.0:1789050096.092915:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087424 00000100:00100000:0.0:1789050096.092919:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087424 00000100:00100000:0.0:1789050096.092960:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 251 00000100:00100000:0.0:1789050096.092967:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704087296:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050096.093129:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704087296:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 160us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050096.093137:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 251 00000100:00100000:0.0:1789050096.093157:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00100000:0.0:1789050096.093165:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704087424:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050096.093206:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704087424:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 42us (8235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050096.093213:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00080000:2.0:1789050096.093602:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050096.093607:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050096.093889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050096.095200:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087168 00000100:00100000:0.0:1789050096.095212:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087168 00000100:00100000:0.0:1789050096.095283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789050096.095294:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704087168:12345-192.168.203.42@tcp:9:kworker.0 00000100:00080000:2.0:1789050096.095357:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1789050096.095418:0:8433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df575b3 00000100:00080000:0.0:1789050096.095428:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8baab7857000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789050096.095483:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789050096.095769:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+2:2402:x1875954704087168:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 476us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050096.095778:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00010000:00010000:1.0:1789050096.096022:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050096.810844:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050097.770931:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714660096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050097.771021:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050097.771379:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660096 00000100:00100000:1.0:1789050097.771387:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660096 00000100:00100000:1.0:1789050097.771445:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789050097.771455:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714660096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050097.771497:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050097.771631:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714660096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050097.771639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789050097.772228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714660096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050097.833108:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050098.281742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050098.281814:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050098.282454:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660224 00000100:00100000:0.0:1789050098.282462:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660224 00000100:00100000:0.0:1789050098.282512:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789050098.282521:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050098.282563:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050098.282619:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050098.282625:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789050098.282839:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050098.857101:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050099.817284:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050099.817323:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050099.817394:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050099.817495:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714660480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050099.817528:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050099.817602:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660352 00000100:00100000:0.0:1789050099.817611:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660352 00000100:00100000:3.0:1789050099.817660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660480 00000100:00100000:3.0:1789050099.817665:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660480 00000100:00100000:0.0:1789050099.817685:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789050099.817726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050099.817747:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050099.817778:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050099.819843:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789050099.819867:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714660480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050099.819894:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050099.820662:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2965us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050099.820673:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1789050099.820805:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd5880 x1875954714660352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050099.820827:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050099.822420:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714660480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2556us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050099.822444:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789050099.824113:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1880 x1875954714660480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050099.824145:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714660480:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789050099.884023:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050100.329217:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714660736:0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.329226:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050100.329289:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050100.329289:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050100.329346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714661120:0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.329369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660736 00000100:00100000:0.0:1789050100.329374:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660608 00000100:00100000:3.0:1789050100.329379:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660736 00000100:00100000:1.0:1789050100.329379:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050100.329382:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660608 00000100:00100000:1.0:1789050100.329404:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714661632:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.329432:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050100.329436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789050100.329448:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714660736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.329461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714662144:0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.329472:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789050100.329484:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050100.329493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050100.329508:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714660736:12345-0@lo:400:kworker.0 Request processed in 62us (218us total) trans 0 rc 0/0 00002000:00000024:0.0:1789050100.329510:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050100.329521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789050100.329532:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714660736:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.329554:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789050100.329561:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714660608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050100.329564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714660992:0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.329574:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789050100.329579:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714660864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050100.329598:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789050100.329600:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050100.329617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050100.329617:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661632 00000100:00100000:0.0:1789050100.329623:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661632 00000100:00100000:0.0:1789050100.329656:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660992 00000100:00100000:0.0:1789050100.329659:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660992 00000100:00100000:0.0:1789050100.329678:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789050100.329684:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.330462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714661376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.330497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050100.330520:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714661888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.330542:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050100.330580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661120 00000100:00100000:3.0:1789050100.330585:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661120 00000100:00100000:3.0:1789050100.331580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661376 00000100:00100000:3.0:1789050100.331603:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661376 00000100:00100000:3.0:1789050100.331633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789050100.331641:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714661120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.332066:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714661120:12345-0@lo:400:kworker.0 Request processed in 412us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050100.332075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789050100.332100:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789050100.332107:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714661376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.332146:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714661376:12345-0@lo:400:kworker.0 Request processed in 40us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050100.332152:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789050100.332196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714661376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050100.332222:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714660864 00000100:00100000:3.0:1789050100.332226:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714660864 00000100:00100000:3.0:1789050100.332259:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789050100.332267:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714660864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050100.332281:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050100.332471:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714660608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050100.332482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714661248:0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.335398:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714661632:12345-0@lo:400:kworker.0 Request processed in 5703us (5956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.335413:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789050100.335449:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661888 00000100:00100000:0.0:1789050100.335474:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661888 00000100:00100000:0.0:1789050100.335511:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789050100.335520:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714660992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.335575:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714660992:12345-0@lo:400:kworker.0 Request processed in 56us (5978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.335581:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789050100.335594:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789050100.335601:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.335644:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714661888:12345-0@lo:400:kworker.0 Request processed in 44us (5100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.335650:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:0.0:1789050100.335679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050100.335684:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050100.335741:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662144 00000100:00100000:0.0:1789050100.335746:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662144 00000100:00100000:0.0:1789050100.335775:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789050100.335781:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714662144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.335814:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714662144:12345-0@lo:400:kworker.0 Request processed in 33us (6322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.335821:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1789050100.335902:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce1c00 x1875954714661888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050100.335918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714661888:0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.336872:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050100.336909:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714661760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.336957:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050100.337011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661248 00000100:00100000:3.0:1789050100.337857:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714660864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5587us (8237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050100.337869:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789050100.337956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714660864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050100.338611:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661760 00000100:00100000:0.0:1789050100.338619:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661760 00000100:00100000:0.0:1789050100.338689:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789050100.338699:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714661760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.338783:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714661760:12345-0@lo:400:kworker.0 Request processed in 87us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.338791:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:3.0:1789050100.338896:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050100.338966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714661760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.339873:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661248 00000100:00100000:2.0:1789050100.339960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789050100.339972:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.340049:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714661248:12345-0@lo:400:kworker.0 Request processed in 81us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050100.340076:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789050100.340133:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714661248:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.343011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714660992:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.343041:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714661504:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.343117:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050100.343173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714662016:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.343202:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050100.343242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714662144:0@lo:400:kworker.0 00000100:00100000:1.0:1789050100.343254:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714661120:0@lo:400:kworker.0 00010000:00080000:1.0:1789050100.343268:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce0700 x1875954714661632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050100.343278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714661632:0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.343364:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714661504 00000100:00100000:0.0:1789050100.343371:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714661504 00000100:00100000:0.0:1789050100.343458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789050100.343469:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714661504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050100.343534:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714661504:12345-0@lo:400:kworker.0 Request processed in 67us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050100.343541:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1789050100.343619:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050100.343994:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714661504:0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.344195:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662016 00000100:00100000:2.0:1789050100.344201:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662016 00000100:00100000:2.0:1789050100.344245:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789050100.344253:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714662016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050100.344307:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714662016:12345-0@lo:400:kworker.0 Request processed in 56us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050100.344313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789050100.344353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714662016:0@lo:400:kworker.0 00010000:00010000:1.0:1789050100.905105:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050101.199383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050101.199414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050101.199443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050101.199465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050101.199495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050101.199525:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087808 00000100:00100000:0.0:1789050101.199536:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087808 00000100:00100000:3.0:1789050101.199548:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088064 00000100:00100000:3.0:1789050101.199555:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088064 00000100:00100000:0.0:1789050101.199594:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087680 00000100:00100000:0.0:1789050101.199598:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087680 00000100:00100000:0.0:1789050101.199611:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087936 00000100:00100000:0.0:1789050101.199613:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087936 00000100:00100000:0.0:1789050101.199629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 259 00000100:00100000:3.0:1789050101.199683:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 260 00000100:00100000:3.0:1789050101.199881:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704087680:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050101.199923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087552 00000100:00100000:1.0:1789050101.199930:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087552 00000100:00100000:1.0:1789050101.199988:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 372 00000100:00100000:1.0:1789050101.199996:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704087552:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050101.200114:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704087808:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050101.200615:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704087680:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 922us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050101.200625:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 260 00000100:00100000:3.0:1789050101.200648:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 261 00000100:00100000:3.0:1789050101.200657:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704087936:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050101.201405:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704087552:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1404us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050101.201415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 372 00000100:00100000:1.0:1789050101.201479:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 262 00000100:00100000:1.0:1789050101.201490:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704088064:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050101.201524:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704088064:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 38us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050101.201532:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 262 00000100:00100000:1.0:1789050101.207927:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704087808:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 8275us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050101.207983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 259 00000100:00100000:3.0:1789050101.209024:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704087936:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 8362us (9528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050101.209037:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 261 00000100:00080000:3.0:1789050101.209085:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050101.209267:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1789050101.866449:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:0.0:1789050101.866458:0:9512:0:(genops.c:885:class_export_put()) final put ffff8baab7854800/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:1.0:1789050101.866517:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7854800/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-OST0001 00000020:00000080:1.0:1789050101.866583:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab7857000 for lustre-OST0001 00010000:00010000:3.0:1789050101.931988:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050102.379811:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789050102.380372:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789050102.889401:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050102.889431:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714662272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050102.889548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050102.889896:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662272 00000100:00100000:1.0:1789050102.889908:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662272 00000100:00100000:1.0:1789050102.890009:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789050102.890021:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714662272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050102.890073:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050102.890139:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714662272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050102.890147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789050102.890264:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714662272:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789050102.953245:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050103.402555:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050103.402588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714662400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050103.402677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050103.402755:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662400 00000100:00100000:0.0:1789050103.402765:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662400 00000100:00100000:0.0:1789050103.402818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789050103.402829:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714662400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050103.402870:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050103.402917:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714662400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050103.402924:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789050103.404273:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714662400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050103.977195:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050104.937438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714662528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050104.937551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050104.937795:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662528 00000100:00100000:0.0:1789050104.937807:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662528 00000100:00100000:0.0:1789050104.937889:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789050104.937902:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714662528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050104.937959:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050104.938017:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714662528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050104.938037:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789050104.938092:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983ce2300 x1875954714662528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050104.938113:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714662528:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789050104.938185:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050104.938605:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714662656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050104.938645:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050104.938726:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662656 00000100:00100000:3.0:1789050104.938732:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662656 00000100:00100000:3.0:1789050104.938789:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789050104.938797:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714662656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050104.938811:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050104.938848:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714662656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050104.938854:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1789050104.938911:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789050104.938932:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baaa7dd6d80 x1875954714662656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050104.938965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714662656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789050105.002507:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050105.450158:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050105.450186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714662784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050105.450295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.450421:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662784 00000100:00100000:0.0:1789050105.450501:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662784 00000100:00080000:0.0:1789050105.450645:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050105.450666:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789050105.450676:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714662784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050105.450709:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050105.450761:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714662784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050105.450768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789050105.451493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714663296:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.451543:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714663040:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.451549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451626:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050105.451632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714663168:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.451676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451705:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714663552:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.451732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714664064:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.451786:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451806:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050105.451812:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714663680:0@lo:400:kworker.0 00000100:00100000:1.0:1789050105.451843:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714664192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050105.451857:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663296 00000100:00100000:1.0:1789050105.451899:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050105.451905:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663296 00000100:00100000:0.0:1789050105.451981:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663040 00000100:00100000:1.0:1789050105.451983:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663552 00000100:00100000:0.0:1789050105.451985:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663040 00000100:00100000:1.0:1789050105.451989:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663552 00000100:00100000:0.0:1789050105.452007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663680 00000100:00100000:0.0:1789050105.452012:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663680 00000100:00100000:1.0:1789050105.452041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789050105.452051:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714663296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.452099:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714663808:0@lo:400:kworker.0 00000100:00100000:1.0:1789050105.452099:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714663296:12345-0@lo:400:kworker.0 Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050105.452142:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050105.452192:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714663296:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.452213:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789050105.452218:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714662912:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.452246:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050105.452270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714663424:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.452292:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050105.452309:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714663936:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.452330:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050105.452351:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663808 00000100:00100000:2.0:1789050105.452355:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663808 00000100:00100000:0.0:1789050105.452497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663936 00000100:00100000:0.0:1789050105.452501:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663936 00000100:00100000:0.0:1789050105.452525:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789050105.452532:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714663040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452573:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714663040:12345-0@lo:400:kworker.0 Request processed in 41us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452580:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789050105.452597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789050105.452610:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714663552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452641:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714663552:12345-0@lo:400:kworker.0 Request processed in 31us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452646:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789050105.452659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789050105.452664:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714663680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452689:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714663680:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452694:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789050105.452703:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789050105.452708:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714663936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452735:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714663936:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789050105.452762:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664064 00000100:00100000:0.0:1789050105.452765:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664064 00000100:00100000:0.0:1789050105.452792:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789050105.452798:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714664064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452828:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714664064:12345-0@lo:400:kworker.0 Request processed in 30us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452845:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789050105.452875:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663168 00000100:00100000:0.0:1789050105.452880:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663168 00000100:00100000:0.0:1789050105.452903:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714663424 00000100:00100000:0.0:1789050105.452906:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714663424 00000100:00100000:0.0:1789050105.452920:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789050105.452925:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714663168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.452992:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714663168:12345-0@lo:400:kworker.0 Request processed in 66us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.452998:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789050105.453011:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789050105.453027:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714663424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.453057:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714663424:12345-0@lo:400:kworker.0 Request processed in 40us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050105.453064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789050105.453106:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714663424:0@lo:400:kworker.0 00010000:00080000:0.0:1789050105.453134:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d92a00 x1875954714663936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050105.453145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714663936:0@lo:400:kworker.0 00000100:00080000:0.0:1789050105.453190:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050105.453196:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050105.453199:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789050105.453232:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d91500 x1875954714663680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050105.453242:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714663680:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.453253:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714663552:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.453262:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714664064:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.453273:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714663168:0@lo:400:kworker.0 00000100:00100000:0.0:1789050105.453296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714663040:0@lo:400:kworker.0 00000100:00100000:1.0:1789050105.454412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789050105.454502:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714662784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050105.456374:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789050105.456396:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714663808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.456519:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714663808:12345-0@lo:400:kworker.0 Request processed in 134us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050105.456527:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789050105.456880:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664192 00000100:00100000:2.0:1789050105.456892:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664192 00000100:00100000:1.0:1789050105.456953:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714663808:0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.456962:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789050105.456970:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714664192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050105.456992:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050105.457055:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714664192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (5157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050105.457061:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789050105.457084:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714662912 00000100:00100000:2.0:1789050105.457088:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714662912 00000100:00100000:1.0:1789050105.457105:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba982448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714664192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050105.457120:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789050105.457128:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714662912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050105.457168:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714662912:12345-0@lo:400:kworker.0 Request processed in 42us (4920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050105.457174:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789050105.457197:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714662912:0@lo:400:kworker.0 00010000:00010000:2.0:1789050106.027338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050106.052401:0:14058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:21:43 (1789050103) 00000100:00100000:3.0:1789050106.325673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050106.325720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050106.325785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088192 00000100:00100000:1.0:1789050106.325802:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088192 00000100:00100000:3.0:1789050106.325851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050106.325881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050106.325898:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 374 00000100:00100000:1.0:1789050106.325913:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704088192:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050106.326005:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050106.326081:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704088192:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 169us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050106.326093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 374 00000100:00100000:2.0:1789050106.326101:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088448 00000100:00100000:2.0:1789050106.326112:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088448 00000100:00100000:2.0:1789050106.327961:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088704 00000100:00100000:2.0:1789050106.327976:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088704 00000100:00100000:2.0:1789050106.328006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088320 00000100:00100000:2.0:1789050106.328036:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088320 00000100:00100000:2.0:1789050106.328059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088576 00000100:00100000:2.0:1789050106.328062:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088576 00000100:00100000:2.0:1789050106.328088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 269 00000100:00100000:2.0:1789050106.328101:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704088448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050106.328851:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 270 00000100:00100000:0.0:1789050106.328880:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704088704:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050106.329227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 271 00000100:00100000:3.0:1789050106.329241:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704088320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:1.0:1789050106.329314:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050106.329323:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050106.329416:0:6518:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1789050106.329430:0:6518:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1789050106.329637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 272 00000100:00100000:1.0:1789050106.329652:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704088576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050106.332856:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704088448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 4754us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050106.332876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 269 00000100:00100000:0.0:1789050106.332901:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704088704:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 3811us (6836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050106.332911:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 270 00000100:00100000:1.0:1789050106.338645:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704088576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 8979us (12623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050106.338677:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 272 00000100:00100000:3.0:1789050106.340691:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704088320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 11438us (14794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050106.340708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 271 00010000:00010000:1.0:1789050107.049343:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050107.652696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050107.652736:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088832 00000100:00100000:0.0:1789050107.652750:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088832 00000100:00100000:0.0:1789050107.652824:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:0.0:1789050107.652836:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:11105:x1875954704088832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050107.652859:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050107.652892:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a75 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653035:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653052:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653069:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050107.653127:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789050107.653131:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050107.653181:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653205:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a75 expref: 7 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653245:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a75 expref: 6 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.653254:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baab0f94600) 00010000:00010000:0.0:1789050107.653258:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050107.653261:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779400, rc 0) 00000100:00100000:0.0:1789050107.653334:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:11105:x1875954704088832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 500us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050107.653340:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:2.0:1789050107.668464:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050107.668774:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088960 00000100:00100000:0.0:1789050107.668789:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088960 00000100:00100000:0.0:1789050107.668875:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789050107.668889:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+6:11106:x1875954704088960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050107.668914:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050107.668979:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a7c expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669072:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669091:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669105:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669121:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669146:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669153:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669246:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669255:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669262:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050107.669306:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789050107.669310:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050107.669330:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669342:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669349:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669357:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669363:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050107.669367:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669382:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669397:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baab0f94600) 00010000:00010000:0.0:1789050107.669400:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050107.669406:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669413:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df576a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669430:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669437:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669442:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669447:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050107.669450:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669456:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669463:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8baab0f94a00) 00010000:00010000:0.0:1789050107.669466:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050107.669469:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669486:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669523:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a7c expref: 8 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669540:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a7c expref: 7 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050107.669546:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baab0f94200) 00010000:00010000:0.0:1789050107.669549:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050107.669551:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779a00, rc 0) 00000100:00100000:0.0:1789050107.669639:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+7:11106:x1875954704088960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 754us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050107.669648:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:3.0:1789050107.675314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050107.675584:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089088 00000100:00100000:0.0:1789050107.675597:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089088 00000100:00100000:0.0:1789050107.675674:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789050107.675686:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:615c64c6-0403-4edc-8952-4a12704f5533+7:11106:x1875954704089088:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789050107.675805:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:615c64c6-0403-4edc-8952-4a12704f5533+7:11106:x1875954704089088:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 Request processed in 121us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050107.675814:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789050107.684274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050107.685267:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089344 00000100:00100000:1.0:1789050107.685286:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089344 00000100:00100000:1.0:1789050107.685373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:1.0:1789050107.685386:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:11106:x1875954704089344:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050107.685412:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050107.685439:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df576bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.685526:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.685546:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.685561:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689383:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689411:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689426:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689595:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7c00/0x3b8ec5973df576d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689622:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7c00/0x3b8ec5973df576d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689629:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7c00/0x3b8ec5973df576d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050107.689642:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789050107.689750:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689759:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689767:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689773:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050107.689777:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689785:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689800:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baab0f94200) 00010000:00010000:1.0:1789050107.689803:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050107.689810:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689816:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df576c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689834:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.689847:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.694754:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.694762:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050107.694768:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.694777:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.694794:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ba9832fc800) 00010000:00010000:1.0:1789050107.694798:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050107.694803:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.694811:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df576cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.696677:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df576bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a83 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.696706:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7c00/0x3b8ec5973df576d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a83 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050107.696716:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:1.0:1789050107.696719:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050107.696735:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7c00, rc 0) 00000100:00100000:1.0:1789050107.696833:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:11106:x1875954704089344:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 11449us (12575us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789050107.696842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:1.0:1789050107.708830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050107.708985:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089472 00000100:00100000:0.0:1789050107.708997:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089472 00000100:00100000:0.0:1789050107.709073:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789050107.709086:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+9:11106:x1875954704089472:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789050107.709237:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+9:11106:x1875954704089472:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 155us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050107.709246:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:3.0:1789050107.722578:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050107.722800:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089600 00000100:00100000:0.0:1789050107.722814:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089600 00000100:00100000:0.0:1789050107.722888:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789050107.722900:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+5:11106:x1875954704089600:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789050107.725162:0:13807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2144us 00000100:00100000:3.0:1789050107.758517:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+5:11106:x1875954704089600:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 35603us (35937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050107.758536:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789050108.013146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714664320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050108.013242:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050108.013373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664320 00000100:00100000:1.0:1789050108.013384:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664320 00000100:00100000:1.0:1789050108.013456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789050108.013467:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714664320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050108.013509:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789050108.013568:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714664320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050108.013576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789050108.013727:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714664320:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050108.076872:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050108.521782:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050108.521879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714664448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050108.522013:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789050108.522398:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789050108.522465:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664448 00000100:00100000:1.0:1789050108.522475:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664448 00000100:00100000:1.0:1789050108.522554:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789050108.522567:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714664448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050108.522610:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789050108.522680:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714664448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050108.522688:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789050108.522753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714664448:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050109.106856:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050109.783230:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050109.787083:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089728 00000100:00100000:0.0:1789050109.787099:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089728 00000100:00100000:0.0:1789050109.787262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789050109.787274:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+9:11148:x1875954704089728:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050109.787296:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789050109.790702:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789050109.790928:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a8a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791137:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791153:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791165:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791203:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791212:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791366:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791419:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791427:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791434:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791440:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050109.791444:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791451:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791463:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baab0f94600) 00010000:00010000:0.0:1789050109.791466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050109.791472:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791479:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df576e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791499:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791505:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791511:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791516:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050109.791519:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791525:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791533:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8baa9294f300) 00010000:00010000:0.0:1789050109.791536:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050109.791538:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791544:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df576ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791586:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a8a expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791598:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baab0f94600) 00010000:00010000:0.0:1789050109.791600:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050109.791610:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df576e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a8a expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.791620:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778200, rc 0) 00000100:00100000:0.0:1789050109.792280:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+9:11148:x1875954704089728:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5005us (9056us total) trans 0 rc 301/301 00000100:00100000:0.0:1789050109.792291:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789050109.803057:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050109.803153:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089984 00000100:00100000:2.0:1789050109.803164:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089984 00000100:00100000:2.0:1789050109.803235:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789050109.803246:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+9:11148:x1875954704089984:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1789050109.803302:0:10357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050109.803332:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df5769a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a75 expref: 9 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803353:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baab0f94600) 00010000:00010000:2.0:1789050109.803364:0:10357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050109.803427:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803447:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803457:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803469:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803476:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.803482:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804429:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804443:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804450:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050109.804464:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a4f873a0 reply state 000000000155b719 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804474:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804481:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050109.804491:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050109.804494:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789050109.804500:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789050109.804509:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804516:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804523:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804529:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050109.804533:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804541:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804551:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baaa1a0e500) 00010000:00010000:2.0:1789050109.804554:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050109.804558:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804564:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df576f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050109.804582:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a4f873a0 reply state 000000000155b719 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804591:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.804609:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8baaa1a0ea00) 00010000:00010000:2.0:1789050109.804612:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050109.804614:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789050109.804731:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+10:11148:x1875954704089984:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 1484us (1682us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789050109.804740:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:3.0:1789050109.908061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050109.908864:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090112 00000100:00100000:1.0:1789050109.908876:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090112 00000100:00100000:3.0:1789050109.909006:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:3.0:1789050109.909019:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+10:11156:x1875954704090112:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:3.0:1789050109.909054:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050109.909089:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5770a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a91 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909166:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909181:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909192:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050109.909247:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789050109.909252:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050109.909300:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909327:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5770a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a91 expref: 12 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909348:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a91 expref: 11 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050109.909356:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:3.0:1789050109.909360:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050109.909364:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:3.0:1789050109.909704:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+11:11156:x1875954704090112:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 688us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050109.909712:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:3.0:1789050109.972635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050109.974599:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090240 00000100:00100000:1.0:1789050109.974617:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090240 00000100:00100000:2.0:1789050109.977227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:2.0:1789050109.977243:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+11:11162:x1875954704090240:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050109.977264:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050109.977286:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a98 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977358:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977372:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977382:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977394:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977400:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977406:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977520:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977530:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977537:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050109.977575:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789050109.977578:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050109.977618:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977630:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977637:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977643:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977649:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050109.977654:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977662:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977673:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050109.977683:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050109.977690:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977697:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df5771f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977713:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977720:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977726:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977731:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050109.977734:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977740:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977747:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8baaa1a0ea00) 00010000:00010000:2.0:1789050109.977749:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050109.977751:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977756:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977783:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a98 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977810:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a98 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.977823:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050109.977825:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050109.977828:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177c00, rc 0) 00000100:00100000:2.0:1789050109.978183:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+12:11162:x1875954704090240:12345-192.168.203.42@tcp:101:bash.0 Request processed in 943us (5557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050109.978192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:0.0:1789050109.987067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050109.987254:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090496 00000100:00100000:2.0:1789050109.987264:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090496 00000100:00100000:2.0:1789050109.987335:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:2.0:1789050109.987346:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+12:11162:x1875954704090496:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050109.987368:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050109.987391:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57734 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966a9f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987513:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987530:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987541:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987598:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987620:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.987627:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050109.988055:0:6520:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789050109.988616:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988629:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988637:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988676:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988683:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988690:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988696:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050109.988700:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988708:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050109.988739:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050109.988744:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988751:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5773b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050109.988767:0:6520:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006405148c reply state 000000005792d205 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988777:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988784:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:2.0:1789050109.988786:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050109.988789:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050109.988822:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57734 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988839:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050109.988847:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:2.0:1789050109.988850:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050109.988852:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176800, rc 0) 00000100:00100000:2.0:1789050109.989688:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+15:11162:x1875954704090496:12345-192.168.203.42@tcp:101:bash.0 Request processed in 2339us (2626us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789050109.989699:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789050109.994442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050109.995175:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090624 00000100:00100000:2.0:1789050109.995187:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090624 00000100:00100000:2.0:1789050109.995288:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:2.0:1789050109.995298:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1875954704090624:12345-192.168.203.42@tcp:8:bash.0 00010000:00080000:2.0:1789050109.995343:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1789050109.995377:0:8434:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df57757 00002000:00100000:2.0:1789050109.995391:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 615c64c6-0403-4edc-8952-4a12704f5533/ffff8baa91f2c000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789050109.995409:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1789050109.995510:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789050109.995543:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8baa91f2c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050109.995623:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704090624:12345-192.168.203.42@tcp:8:bash.0 Request processed in 324us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050109.995630:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789050109.997802:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050109.998238:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090752 00000100:00100000:0.0:1789050109.998250:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090752 00000100:00100000:0.0:1789050109.998330:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:0.0:1789050109.998343:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:0:x1875954704090752:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050109.998360:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050109.998441:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966aa6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050109.998467:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050109.998486:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1789050109.998491:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050109.998500:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.998522:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050109.998535:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778000, rc 0) 00000100:00100000:0.0:1789050109.998608:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:0:x1875954704090752:12345-192.168.203.42@tcp:101:bash.0 Request processed in 268us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050109.998615:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00080000:3.0:1789050110.000642:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050110.001475:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.001514:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090880 00000100:00100000:3.0:1789050110.001524:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090880 00000100:00100000:3.0:1789050110.001577:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:3.0:1789050110.001587:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:11162:x1875954704090880:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050110.001605:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050110.001626:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966aad expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.001658:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.001667:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050110.001672:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050110.001677:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.001712:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.001726:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.001762:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714664576:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050110.001850:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87861840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050110.004685:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714664576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050110.004722:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.004743:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603600, rc 0) 00000100:00100000:3.0:1789050110.004805:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:11162:x1875954704090880:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3218us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.004814:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:3.0:1789050110.006901:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.007044:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091008 00000100:00100000:0.0:1789050110.007054:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091008 00010000:00010000:0.0:1789050110.007218:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050110.007300:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789050110.007313:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704091008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050110.007329:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050110.007354:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.007368:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.007395:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a653e5e9/0x3b8ec5973df5775e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aa6 expref: 8 pid: 8433 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.007423:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050110.007428:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050110.007439:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.007449:0:7460:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.007506:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050110.007524:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1875954714664704:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789050110.007604:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab40e2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050110.012023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.012267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091264 00000100:00100000:0.0:1789050110.012277:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091264 00000100:00100000:0.0:1789050110.012334:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789050110.012345:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:11162:x1875954704091264:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:0.0:1789050110.012605:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:0.0:1789050110.012737:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+17:11162:x1875954704091264:12345-192.168.203.42@tcp:35:bash.0 Request processed in 393us (724us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789050110.012746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000020:00080000:0.0:1789050110.012751:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050110.016323:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1875954714664704:192.168.203.42@tcp:105: 00010000:00010000:2.0:1789050110.016356:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050110.016525:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704091008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9213us (9635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.016536:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789050110.058257:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050110.058284:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714664832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050110.058364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.058609:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664832 00000100:00100000:3.0:1789050110.058617:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664832 00000100:00100000:3.0:1789050110.058693:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789050110.058704:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714664832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050110.058727:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050110.058808:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714664832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.058816:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789050110.058870:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714664832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050110.059046:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050110.059252:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050110.059264:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714664960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050110.059299:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050110.059383:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714664960 00000100:00100000:2.0:1789050110.059389:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714664960 00000100:00080000:0.0:1789050110.059504:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050110.059595:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789050110.059604:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714664960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050110.059617:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050110.059666:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714664960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.059673:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789050110.060699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714664960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050110.098682:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.098792:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091520 00000100:00100000:0.0:1789050110.098808:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091520 00000100:00100000:0.0:1789050110.099006:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789050110.099018:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+17:11172:x1875954704091520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050110.099046:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050110.099068:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df5776c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ab4 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050110.099194:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789050110.099300:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df5776c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ab4 expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.099315:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:0.0:1789050110.099319:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050110.099325:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df5776c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ab4 expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.099339:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778000, rc 0) 00000100:00100000:0.0:1789050110.099403:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+18:11172:x1875954704091520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 389us (736us total) trans 4294967316 rc 301/301 00000100:00100000:0.0:1789050110.099410:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789050110.103067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.103282:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091776 00000100:00100000:3.0:1789050110.103306:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091776 00000100:00100000:3.0:1789050110.103361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:3.0:1789050110.103372:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:11172:x1875954704091776:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050110.103711:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:11172:x1875954704091776:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 339us (651us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789050110.103719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00010000:00010000:1.0:1789050110.121192:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050110.197150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.197320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091904 00000100:00100000:0.0:1789050110.197331:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091904 00000100:00100000:0.0:1789050110.197398:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789050110.197410:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:11178:x1875954704091904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050110.197447:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050110.197469:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df5777a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966abb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197538:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197579:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050110.197628:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789050110.197631:0:6519:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050110.197650:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197674:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df5777a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966abb expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197691:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966abb expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.197699:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050110.197702:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050110.197705:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779800, rc 0) 00000100:00100000:0.0:1789050110.197770:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+20:11178:x1875954704091904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 362us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050110.197776:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789050110.204972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.205157:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092160 00000100:00100000:3.0:1789050110.205167:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092160 00000100:00100000:3.0:1789050110.205233:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:3.0:1789050110.205245:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+20:11178:x1875954704092160:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050110.205269:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050110.205290:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57788 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ac2 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.205406:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5778f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.205430:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5778f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.205443:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5778f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050110.205455:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789050110.205569:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57788 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac2 expref: 23 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.205587:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5778f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac2 expref: 22 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.205617:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:3.0:1789050110.205621:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050110.205625:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050110.205697:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+22:11178:x1875954704092160:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 453us (733us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789050110.205704:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:3.0:1789050110.211917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.212023:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.212044:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092416 00000100:00100000:2.0:1789050110.212058:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092416 00000100:00100000:0.0:1789050110.212109:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092544 00000100:00100000:0.0:1789050110.212125:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092544 00000100:00100000:2.0:1789050110.212128:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050110.212142:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+23:11178:x1875954704092416:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050110.212164:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050110.212184:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5779d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ac9 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050110.212188:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789050110.212202:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+24:2403:x1875954704092544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050110.212215:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050110.212237:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5778f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac2 expref: 24 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.212270:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:0.0:1789050110.212276:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050110.212287:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.212303:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.212314:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050110.212326:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:0.0:1789050110.212335:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:2403:x1875954704092544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050110.212344:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00010000:00010000:2.0:1789050110.212428:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5779d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac9 expref: 24 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.212444:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac9 expref: 23 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.212452:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:2.0:1789050110.212454:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789050110.212457:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:2.0:1789050110.212481:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+23:11178:x1875954704092416:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 343us (577us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789050110.212497:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:1.0:1789050110.221606:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.222235:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092672 00000100:00100000:3.0:1789050110.222245:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092672 00000100:00100000:3.0:1789050110.222313:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:3.0:1789050110.222323:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baabdf33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704092672:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:3.0:1789050110.222366:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.222386:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.222395:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050110.222399:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050110.222404:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.222458:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.222495:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 7 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.222512:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714665088:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050110.222628:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa83ab5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050110.229709:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714665088:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050110.229742:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050110.230310:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.232578:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092800 00000100:00100000:0.0:1789050110.232589:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092800 00002000:00100000:0.0:1789050110.232643:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ba983dac700 x1875954704092800/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:611/0 lens 504/0 e 0 to 0 dl 1789050121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050110.232654:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983dac700 with x1875954704092800 ext(0->12) 00010000:00010000:0.0:1789050110.232662:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 8 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.232680:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 8 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050110.232688:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983dac700 00000100:00100000:0.0:1789050110.232723:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:0.0:1789050110.232733:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704092800:12345-192.168.203.42@tcp:4:lfs.0 00000001:00100000:2.0:1789050110.241088:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000100:00100000:0.0:1789050110.241750:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704092800:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 9009us (11435us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789050110.241763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00002000:00100000:0.0:1789050110.241778:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ba983dac700 x1875954704092800/t4294967300(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:611/0 lens 504/448 e 0 to 0 dl 1789050121 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050110.241809:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983dac700 with x1875954704092800 ext(0->12) 00010000:00010000:0.0:1789050110.241820:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.241836:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050110.241845:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983dac700 00000100:00100000:1.0:1789050110.245904:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.246782:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092928 00000100:00100000:2.0:1789050110.246795:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092928 00010000:00010000:2.0:1789050110.246842:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050110.246895:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050110.246905:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704092928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050110.246931:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789050110.247214:0:7461:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789050110.247218:0:7461:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789050109089484254 00002000:00010000:2.0:1789050110.247220:0:7461:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789050109296529677 00002000:00010000:2.0:1789050110.247222:0:7461:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789050109089484254 00002000:00010000:2.0:1789050110.247224:0:7461:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789050110.247232:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.247247:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.247273:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25450c6/0x3b8ec5973df57765 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aad expref: 9 pid: 8433 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.247290:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050110.247308:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050110.247315:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.247325:0:7461:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.247366:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050110.247439:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704092928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 535us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.247447:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00010000:00010000:3.0:1789050110.248702:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248718:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248745:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248754:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248763:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248791:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050110.248796:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248806:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248827:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.248835:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df577b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.249107:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baabdf33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704092672:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 26782us (27508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.249128:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:1.0:1789050110.251433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.251561:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093184 00000100:00100000:3.0:1789050110.251572:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093184 00000100:00100000:3.0:1789050110.251680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:3.0:1789050110.251691:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:11178:x1875954704093184:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:3.0:1789050110.251755:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac9 expref: 23 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050110.252036:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789050110.252069:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789050110.252608:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1789050110.252650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.252666:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.252676:0:6521:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.252710:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.252725:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 27 pid: 6520 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.252746:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714665216:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050110.252825:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789050110.258662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050110.258699:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093312 00000100:00100000:1.0:1789050110.258708:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093312 00010000:00010000:1.0:1789050110.258747:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 28 pid: 6520 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050110.258783:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:1.0:1789050110.258793:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+28:2404:x1875954704093312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050110.258813:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050110.258820:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 28 pid: 6520 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050110.258833:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 28 pid: 6520 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050110.258866:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:1.0:1789050110.258887:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050110.258897:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050110.258904:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050110.258955:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050110.259017:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+28:2404:x1875954704093312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 225us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050110.259024:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00010000:00010000:3.0:1789050110.260342:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a9f expref: 27 pid: 6520 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.260363:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714665216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050110.260385:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.260395:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.260399:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050110.260552:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:3.0:1789050110.260674:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789050110.260764:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714665344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789050110.260841:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.260879:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050110.261300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665344 00000100:00100000:1.0:1789050110.261308:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665344 00000100:00100000:1.0:1789050110.261353:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789050110.261362:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714665344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789050110.261461:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714665344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050110.261468:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789050110.262446:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714665344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789050110.262604:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:3.0:1789050110.262665:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714665472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789050110.262707:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.262729:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050110.264330:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665472 00000100:00100000:1.0:1789050110.264342:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665472 00000100:00100000:1.0:1789050110.264396:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789050110.264405:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714665472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789050110.264584:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875954714665472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (1876us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789050110.264591:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789050110.264766:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714665472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789050110.264831:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789050110.264884:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.264896:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.264904:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.264909:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050110.264914:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.265145:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.265185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:3.0:1789050110.265188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789050110.265198:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.265208:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df577b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050110.265331:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789050110.265550:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789050110.265562:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332463624390ns, next at 333463622195ns, rc = 0 00000001:00080000:3.0:1789050110.265572:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:3.0:1789050110.265604:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaa1a0e700) 00010000:00010000:3.0:1789050110.265607:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789050110.265774:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ac9 expref: 31 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.265900:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+30:11178:x1875954704093184:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 14211us (14486us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789050110.266823:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000020:00080000:3.0:1789050110.266833:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789050110.271698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.271879:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093440 00000100:00100000:0.0:1789050110.271888:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093440 00000100:00100000:0.0:1789050110.272753:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789050110.272769:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+30:11178:x1875954704093440:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050110.272793:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050110.272816:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df577c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ad0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.272886:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df577c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ad0 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.272901:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df577c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ad0 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.272920:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050110.272923:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050110.272927:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778000, rc 0) 00000100:00100000:0.0:1789050110.273008:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+31:11178:x1875954704093440:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 244us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050110.273030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:1.0:1789050110.277053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.277769:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093696 00000100:00100000:0.0:1789050110.277779:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093696 00000100:00100000:0.0:1789050110.277834:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789050110.277844:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+31:11178:x1875954704093696:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050110.278166:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+32:11178:x1875954704093696:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 321us (1235us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789050110.278176:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789050110.368641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.369164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093952 00000100:00100000:2.0:1789050110.369174:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093952 00000100:00100000:2.0:1789050110.369247:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:2.0:1789050110.369258:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+32:11188:x1875954704093952:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050110.369282:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050110.369304:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df577c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ad7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050110.369401:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789050110.369502:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df577c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ad7 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.369516:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050110.369519:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050110.369524:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df577c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ad7 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.369558:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:2.0:1789050110.369615:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+33:11188:x1875954704093952:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 359us (984us total) trans 4294967330 rc 301/301 00000100:00100000:2.0:1789050110.369622:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:1.0:1789050110.374200:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.374465:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094080 00000100:00100000:2.0:1789050110.374476:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094080 00000100:00100000:2.0:1789050110.374540:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789050110.374550:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+33:11188:x1875954704094080:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789050110.374643:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.374658:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.374670:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.374680:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.374687:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.374693:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375069:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375096:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375103:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050110.375151:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375163:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375170:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375177:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375183:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.375187:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375195:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375207:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050110.375210:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050110.375214:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.375220:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376467:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376477:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376484:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376490:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.376494:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376501:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376515:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:2.0:1789050110.376518:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050110.376521:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376527:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376538:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376545:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376550:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376570:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.376573:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376580:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376589:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050110.376591:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050110.376595:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.376601:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050110.376705:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+33:11188:x1875954704094080:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 2152us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.376714:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:1.0:1789050110.390859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.391053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094336 00000100:00100000:3.0:1789050110.391064:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094336 00000100:00100000:3.0:1789050110.391175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789050110.391186:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+33:11188:x1875954704094336:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050110.391447:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+34:11188:x1875954704094336:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 263us (599us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789050110.391475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789050110.431648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.433485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094592 00000100:00100000:2.0:1789050110.433513:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094592 00000100:00100000:2.0:1789050110.433589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789050110.433601:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+34:11191:x1875954704094592:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050110.433625:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050110.433647:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ade expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433738:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433774:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433786:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433801:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433809:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433817:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433931:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.433997:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434005:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050110.434016:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789050110.434094:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434102:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434108:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434120:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.434124:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434132:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434144:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050110.434147:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050110.434152:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434158:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df577f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434172:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434179:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434185:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434191:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.434194:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434200:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434218:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:2.0:1789050110.434221:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050110.434225:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.434243:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df577f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.435538:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df577ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.435567:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.435576:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050110.435579:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050110.435583:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:2.0:1789050110.435664:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+36:11191:x1875954704094592:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2064us (4024us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789050110.435673:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789050110.445882:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.446020:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094720 00000100:00100000:2.0:1789050110.446030:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094720 00000100:00100000:2.0:1789050110.446096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:2.0:1789050110.446107:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+36:11191:x1875954704094720:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050110.446173:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446191:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446217:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446266:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446284:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446292:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446300:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050110.446304:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446312:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446326:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050110.446329:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050110.446336:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.446342:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5780d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050110.446422:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+36:11191:x1875954704094720:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 317us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.446431:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789050110.460010:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.460164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094976 00000100:00100000:0.0:1789050110.460173:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094976 00000100:00100000:0.0:1789050110.460238:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789050110.460248:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+36:11191:x1875954704094976:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050110.460489:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+37:11191:x1875954704094976:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 241us (488us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789050110.460496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789050110.569216:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050110.569253:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714665600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050110.569329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.569443:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665600 00000100:00100000:3.0:1789050110.569452:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665600 00000100:00080000:1.0:1789050110.569515:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050110.569526:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789050110.569537:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714665600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050110.569568:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050110.569623:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714665600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.569629:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789050110.569825:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714665600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050110.570423:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714666112:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570461:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.570484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714666624:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570519:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.570545:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789050110.570550:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714665728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050110.570573:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.570587:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714666240:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570609:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.570623:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714666752:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570642:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.570673:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666112 00000100:00100000:3.0:1789050110.570679:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666112 00000100:00100000:3.0:1789050110.570709:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789050110.570717:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714666112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570762:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714666112:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.570784:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789050110.570830:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714666112:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570853:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666624 00000100:00100000:3.0:1789050110.570856:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666624 00000100:00100000:3.0:1789050110.570885:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666240 00000100:00100000:3.0:1789050110.570887:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666240 00000100:00100000:3.0:1789050110.570901:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789050110.570908:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714666624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.570973:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714666624:12345-0@lo:400:kworker.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.570979:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789050110.571003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666752 00000100:00100000:3.0:1789050110.571006:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666752 00000100:00100000:3.0:1789050110.571027:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050110.571033:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714666240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571063:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714666240:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.571069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050110.571081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789050110.571087:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9836a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714666752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571112:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9836a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714666752:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.571118:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789050110.571144:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714666240:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571154:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714666752:0@lo:400:kworker.0 00010000:00080000:3.0:1789050110.571175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c4fb80 x1875954714666624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050110.571186:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714666624:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571432:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571464:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571484:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714666496:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571520:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571536:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714667008:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571557:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571576:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789050110.571582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714665856:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714666368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571648:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571665:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714666880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571686:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050110.571712:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666368 00000100:00100000:3.0:1789050110.571716:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666368 00000100:00100000:3.0:1789050110.571741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789050110.571748:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714666368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571784:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714666368:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.571790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789050110.571817:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714666368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571844:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665984 00000100:00100000:3.0:1789050110.571848:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665984 00000100:00100000:3.0:1789050110.571866:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666496 00000100:00100000:3.0:1789050110.571868:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666496 00000100:00100000:3.0:1789050110.571882:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714666880 00000100:00100000:3.0:1789050110.571884:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714666880 00000100:00100000:3.0:1789050110.571901:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789050110.571907:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714665984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.571965:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714665984:12345-0@lo:400:kworker.0 Request processed in 57us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.571972:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789050110.571995:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789050110.572002:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714666496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.572028:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714666496:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.572033:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789050110.572045:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789050110.572050:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714666880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.572076:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714666880:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.572080:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:3.0:1789050110.572104:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c4ed80 x1875954714666880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050110.572115:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714666880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.572124:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.572143:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714666496:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.579442:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665728 00000100:00100000:3.0:1789050110.579455:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665728 00000100:00100000:3.0:1789050110.579525:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789050110.579535:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714665728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050110.579564:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050110.579644:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714665728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (9069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.579651:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789050110.579709:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714665728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050110.579752:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714667008 00000100:00100000:3.0:1789050110.579757:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714667008 00000100:00100000:3.0:1789050110.579784:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789050110.579790:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714667008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.579826:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714667008:12345-0@lo:400:kworker.0 Request processed in 37us (8268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.579833:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789050110.579861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714667008:0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.579896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714665856 00000100:00100000:3.0:1789050110.579900:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714665856 00000100:00100000:3.0:1789050110.579926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789050110.579932:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714665856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050110.580003:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714665856:12345-0@lo:400:kworker.0 Request processed in 70us (8394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.580010:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789050110.580067:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714665856:0@lo:400:kworker.0 00000100:00080000:1.0:1789050110.581331:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050110.581338:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050110.581341:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050110.772663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.772754:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095232 00000100:00100000:3.0:1789050110.772764:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095232 00000100:00100000:3.0:1789050110.772841:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:3.0:1789050110.772853:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+37:11222:x1875954704095232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789050110.772881:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050110.772902:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57814 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ae5 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.773058:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5781b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.773074:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5781b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.773086:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5781b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050110.773097:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789050110.773259:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57814 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ae5 expref: 40 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.773277:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5781b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ae5 expref: 39 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.773286:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050110.773289:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050110.773293:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050110.773355:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+39:11222:x1875954704095232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 504us (703us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789050110.773371:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:1.0:1789050110.777228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.777334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095488 00000100:00100000:0.0:1789050110.777344:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095488 00000100:00100000:0.0:1789050110.777407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:0.0:1789050110.777418:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+39:11222:x1875954704095488:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1789050110.777701:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+40:11222:x1875954704095488:12345-192.168.203.42@tcp:35:cat.0 Request processed in 284us (486us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789050110.777708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789050110.780197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050110.780286:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095616 00000100:00100000:0.0:1789050110.780296:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095616 00000100:00100000:0.0:1789050110.780361:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789050110.780388:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+40:2403:x1875954704095616:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050110.780404:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050110.780440:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5781b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ae5 expref: 40 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050110.780458:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050110.780463:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050110.780512:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+39:2403:x1875954704095616:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 127us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050110.780518:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789050110.892149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.892282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095872 00000100:00100000:3.0:1789050110.892292:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095872 00000100:00100000:3.0:1789050110.892359:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:3.0:1789050110.892369:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+39:11228:x1875954704095872:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789050110.892394:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050110.892398:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789050110.892436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57781 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966abb expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892457:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050110.892462:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050110.892475:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57829 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966aec expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892579:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892592:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892601:0:6519:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892633:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.892646:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 39 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050110.892678:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714667136:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050110.892791:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baac20c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050110.898954:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714667136:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050110.899004:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050110.899403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050110.899496:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096000 00000100:00100000:2.0:1789050110.899518:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096000 00010000:00010000:2.0:1789050110.899555:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 40 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050110.899596:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:2.0:1789050110.899617:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+40:2403:x1875954704096000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050110.899632:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050110.899639:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 40 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899650:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 40 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899673:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df577ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ade expref: 40 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899691:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050110.899697:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899707:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899714:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050110.899745:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050110.899805:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+39:2403:x1875954704096000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 200us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050110.899824:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00010000:00010000:3.0:1789050110.902353:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.902371:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050110.902396:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789050110.902625:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57829 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.902648:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.902657:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050110.902660:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050110.902664:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050110.902789:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+39:11228:x1875954704095872:12345-192.168.203.42@tcp:101:dd.0 Request processed in 10419us (10648us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789050110.902797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:1.0:1789050110.907858:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.911254:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096128 00000100:00100000:3.0:1789050110.911286:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096128 00000100:00100000:3.0:1789050110.911355:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789050110.911364:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+39:11228:x1875954704096128:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789050110.911389:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050110.912204:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5783e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966af3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912251:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912267:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912279:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912483:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5783e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912503:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.912512:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050110.912516:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050110.912520:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050110.912638:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+40:11228:x1875954704096128:12345-192.168.203.42@tcp:101:dd.0 Request processed in 1274us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050110.912647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789050110.930855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050110.931377:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096384 00000100:00100000:3.0:1789050110.931402:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096384 00000100:00100000:3.0:1789050110.931510:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:3.0:1789050110.931522:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+40:11228:x1875954704096384:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:3.0:1789050110.931828:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.931846:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.931858:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050110.931898:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789050110.931924:0:10357:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002f03d7a6 reply state 0000000091f99956 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.931988:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050110.931998:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050110.932001:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050110.932005:0:10357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050110.932106:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+43:11228:x1875954704096384:12345-192.168.203.42@tcp:36:dd.0 Request processed in 586us (1262us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789050110.932123:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000020:00080000:3.0:1789050110.932129:0:10357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050111.145125:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050111.351641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050111.351777:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096512 00000100:00100000:2.0:1789050111.351787:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096512 00000100:00100000:2.0:1789050111.351909:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:2.0:1789050111.351921:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+43:11243:x1875954704096512:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:2.0:1789050111.351985:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789050111.352360:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050111.355441:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966afa expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355617:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355635:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355648:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355659:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355665:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.355671:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.359533:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.359580:0:13807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.359589:0:13807:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.359635:0:13807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.359653:0:13807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 44 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050111.359669:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714667264:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050111.359896:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87861840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050111.371339:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050111.371582:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096768 00000100:00100000:0.0:1789050111.371592:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096768 00000100:00100000:2.0:1789050111.371624:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714667264:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050111.371654:0:13807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050111.371659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789050111.371673:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+45:6175:x1875954704096768:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789050111.374298:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+46:6175:x1875954704096768:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 2616us (2958us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789050111.374312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:1.0:1789050111.380834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050111.381041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096896 00000100:00100000:2.0:1789050111.381054:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096896 00010000:00010000:2.0:1789050111.381100:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 46 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050111.381148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789050111.381157:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+46:2404:x1875954704096896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050111.381173:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050111.381196:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 46 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381209:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 46 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57830 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966aec expref: 46 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381246:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050111.381251:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381261:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381270:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.381305:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050111.381375:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+45:2404:x1875954704096896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 219us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050111.381383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00010000:00010000:3.0:1789050111.381510:0:13807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381518:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050111.381584:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789050111.381588:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050111.381628:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381642:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381652:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381659:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381666:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381671:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050111.381676:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381684:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381692:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050111.381695:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050111.381699:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381705:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df5785a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381727:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381733:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381740:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381745:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050111.381748:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381754:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381763:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:3.0:1789050111.381765:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050111.381768:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381773:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381804:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966afa expref: 45 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381820:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966afa expref: 44 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.381838:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050111.381840:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050111.381843:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031400, rc 0) 00000100:00100000:3.0:1789050111.381883:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+44:11243:x1875954704096512:12345-192.168.203.42@tcp:101:stat.0 Request processed in 29966us (30252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050111.381891:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:1.0:1789050111.435318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.435392:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.435467:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.435516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.435543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.435569:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097536 00000100:00100000:1.0:1789050111.435578:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097536 00000100:00100000:1.0:1789050111.435631:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097152 00000100:00100000:1.0:1789050111.435634:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097152 00000100:00100000:1.0:1789050111.435657:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097408 00000100:00100000:1.0:1789050111.435660:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097408 00000100:00100000:1.0:1789050111.435681:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 279 00000100:00100000:1.0:1789050111.435691:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704097536:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050111.435761:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704097536:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.435768:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 279 00000100:00100000:1.0:1789050111.435784:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 280 00000100:00100000:1.0:1789050111.435791:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704097152:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050111.435816:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+5:2406:x1875954704097152:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.435823:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 280 00000100:00100000:1.0:1789050111.435835:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 281 00000100:00100000:1.0:1789050111.435841:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704097408:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050111.435866:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2406:x1875954704097408:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.435871:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 281 00000100:00080000:1.0:1789050111.435887:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050111.435890:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050111.436202:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097024 00000100:00100000:2.0:1789050111.436208:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097024 00000100:00100000:2.0:1789050111.436240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 376 00000100:00100000:2.0:1789050111.436247:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704097024:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050111.436275:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2406:x1875954704097024:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050111.436294:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 376 00000100:00100000:0.0:1789050111.439853:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097280 00000100:00100000:0.0:1789050111.439867:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097280 00000100:00100000:0.0:1789050111.439988:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:0.0:1789050111.439999:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2406:x1875954704097280:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050111.440075:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2406:x1875954704097280:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 78us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050111.440082:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00080000:1.0:1789050111.441051:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050111.469437:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.469568:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097792 00000100:00100000:1.0:1789050111.469581:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097792 00000100:00100000:1.0:1789050111.469659:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789050111.469669:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+44:11250:x1875954704097792:12345-192.168.203.42@tcp:36:truncate.0 00010000:00010000:1.0:1789050111.469727:0:14070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050111.469754:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966afa expref: 44 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.469776:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050111.469781:0:14070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050111.471019:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.471040:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.471053:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050111.471126:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:1.0:1789050111.471161:0:14070:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d1d3876e reply state 00000000038cdeff transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.471174:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.471183:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050111.471186:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789050111.471190:0:14070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050111.471327:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+46:11250:x1875954704097792:12345-192.168.203.42@tcp:36:truncate.0 Request processed in 1656us (1900us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789050111.471355:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000020:00080000:1.0:1789050111.471361:0:14070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050111.623146:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.623390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097920 00000100:00100000:1.0:1789050111.623401:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097920 00000100:00100000:1.0:1789050111.623518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:1.0:1789050111.623529:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+46:11264:x1875954704097920:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:1.0:1789050111.623554:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050111.623575:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57876 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b01 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623644:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623659:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623671:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623683:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623690:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623697:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623772:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623797:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623805:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050111.623848:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789050111.623865:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050111.623888:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623901:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623909:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623916:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623923:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623929:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050111.623933:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.623986:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624000:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050111.624009:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050111.624014:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624021:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df5787d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624038:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624044:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624050:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624055:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050111.624058:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624065:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624072:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:1.0:1789050111.624075:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050111.624078:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624083:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624110:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57876 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624137:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.624144:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050111.624146:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050111.624149:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043200, rc 0) 00000100:00100000:1.0:1789050111.624214:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+47:11264:x1875954704097920:12345-192.168.203.42@tcp:101:stat.0 Request processed in 687us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.624221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:3.0:1789050111.717393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.717521:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098176 00000100:00100000:1.0:1789050111.717533:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098176 00000100:00100000:1.0:1789050111.717647:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:1.0:1789050111.717659:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+47:11274:x1875954704098176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050111.717681:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050111.717701:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b08 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050111.717811:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789050111.718687:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57892 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b08 expref: 49 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.718705:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:0.0:1789050111.718708:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050111.718714:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b08 expref: 49 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.718731:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:0.0:1789050111.718844:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+48:11274:x1875954704098176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1187us (1460us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1789050111.718924:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:2.0:1789050111.726284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050111.726365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098432 00000100:00100000:3.0:1789050111.726376:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098432 00000100:00100000:3.0:1789050111.726439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789050111.726449:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+48:11274:x1875954704098432:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050111.726711:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+49:11274:x1875954704098432:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 262us (436us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789050111.726719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789050111.763141:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050111.766073:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098688 00000100:00100000:3.0:1789050111.766088:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098688 00000100:00100000:3.0:1789050111.766671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:3.0:1789050111.766682:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+49:11280:x1875954704098688:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050111.766706:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050111.766727:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df578a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.766831:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.766864:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.766873:0:6519:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.766907:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.766920:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 50 pid: 6520 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050111.766933:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714667392:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050111.767079:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa812540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050111.776047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050111.776304:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714667392:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050111.776338:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050111.777722:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098816 00000100:00100000:2.0:1789050111.777733:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098816 00010000:00010000:2.0:1789050111.777778:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 51 pid: 6520 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050111.777928:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789050111.777960:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+51:2403:x1875954704098816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050111.777985:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050111.777992:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 51 pid: 6520 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778005:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 51 pid: 6520 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778026:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5788b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b01 expref: 51 pid: 6520 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778045:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050111.778050:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778060:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778068:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.778122:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050111.778246:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+50:2403:x1875954704098816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 308us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050111.778254:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00010000:00010000:3.0:1789050111.778357:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.778365:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050111.778385:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789050111.778530:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df578a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.778558:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050111.778565:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050111.778568:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050111.778571:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050111.778597:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98356b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+50:11280:x1875954704098688:12345-192.168.203.42@tcp:101:bash.0 Request processed in 11917us (15466us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789050111.778604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:2.0:1789050111.783678:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050111.784779:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099072 00000100:00100000:3.0:1789050111.784791:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099072 00000100:00100000:0.0:1789050111.784927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789050111.785069:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+50:11280:x1875954704099072:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:0.0:1789050111.785421:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.785440:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.785453:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050111.785499:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:0.0:1789050111.785522:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006cc9dd88 reply state 000000006bd1d8c9 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.785598:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050111.785624:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050111.785627:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050111.785631:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050111.785730:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+53:11280:x1875954704099072:12345-192.168.203.42@tcp:36:bash.0 Request processed in 793us (2060us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789050111.785738:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000020:00080000:0.0:1789050111.785743:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050111.800176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050111.800264:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099200 00000100:00100000:2.0:1789050111.800274:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099200 00000100:00100000:2.0:1789050111.800328:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:2.0:1789050111.800337:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+53:11280:x1875954704099200:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050111.800366:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050111.800387:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df578bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b16 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.800503:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.800518:0:13807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.800527:0:13807:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.800560:0:13807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.800577:0:13807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 54 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050111.800604:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dad180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714667520:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050111.800703:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98366d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050111.804672:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dad180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714667520:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050111.804703:0:13807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050111.805028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.805830:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099328 00000100:00100000:1.0:1789050111.805841:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099328 00010000:00010000:1.0:1789050111.805882:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 55 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050111.805932:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789050111.806006:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+55:2403:x1875954704099328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050111.806022:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050111.806032:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 55 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806047:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 55 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806075:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df578a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b0f expref: 55 pid: 6519 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806096:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050111.806103:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806114:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806123:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.806153:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050111.806217:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+54:2403:x1875954704099328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 215us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.806225:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00010000:00010000:2.0:1789050111.806305:0:13807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.806315:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050111.806371:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789050111.806377:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050111.806396:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.806428:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df578bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b16 expref: 54 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.806446:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b16 expref: 53 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050111.806454:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050111.806457:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050111.806460:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030c00, rc 0) 00000100:00100000:2.0:1789050111.806490:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+53:11280:x1875954704099200:12345-192.168.203.42@tcp:101:bash.0 Request processed in 6154us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050111.806505:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789050111.814771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050111.815381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099584 00000100:00100000:0.0:1789050111.815396:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099584 00000100:00100000:0.0:1789050111.815476:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789050111.815487:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+53:11280:x1875954704099584:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789050111.815761:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+54:11280:x1875954704099584:12345-192.168.203.42@tcp:35:bash.0 Request processed in 275us (999us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789050111.815769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:3.0:1789050111.929019:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.929680:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099840 00000100:00100000:1.0:1789050111.929691:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099840 00000100:00100000:1.0:1789050111.929751:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:1.0:1789050111.929760:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+54:11290:x1875954704099840:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050111.929807:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050111.929829:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b1d expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050111.929922:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789050111.930057:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b1d expref: 56 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.930072:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:1.0:1789050111.930075:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050111.930080:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b1d expref: 56 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.930095:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043000, rc 0) 00000100:00100000:1.0:1789050111.930168:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+55:11290:x1875954704099840:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 402us (1151us total) trans 4294967348 rc 301/301 00000100:00100000:1.0:1789050111.930176:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:0.0:1789050111.945046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.945272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099968 00000100:00100000:1.0:1789050111.945283:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099968 00000100:00100000:1.0:1789050111.945350:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:1.0:1789050111.945359:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+55:11290:x1875954704099968:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:1.0:1789050111.945426:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945440:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945451:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945480:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945488:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945496:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945573:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945584:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945590:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050111.945637:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945649:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945656:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945663:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945669:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050111.945673:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945687:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945699:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050111.945702:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050111.945708:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945714:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df578d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945729:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945735:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945741:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945746:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050111.945748:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945754:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.945761:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:1.0:1789050111.945764:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050111.945767:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946835:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df578df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946859:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946866:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946873:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946878:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050111.946882:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946889:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946900:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050111.946902:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050111.946906:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050111.946912:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df578e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050111.947038:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+55:11290:x1875954704099968:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1677us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050111.947048:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:0.0:1789050111.958910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050111.959087:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100224 00000100:00100000:1.0:1789050111.959099:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100224 00000100:00100000:1.0:1789050111.959195:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:1.0:1789050111.959205:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+55:11290:x1875954704100224:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050111.959447:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+56:11290:x1875954704100224:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 242us (549us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789050111.959455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:3.0:1789050112.010916:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.011591:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100480 00000100:00100000:0.0:1789050112.011605:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100480 00000100:00100000:0.0:1789050112.012918:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:0.0:1789050112.013048:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+56:11293:x1875954704100480:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050112.013077:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050112.013106:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df578ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b24 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013221:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013244:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013257:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013268:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013275:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013281:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013419:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013429:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013435:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050112.013446:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789050112.013537:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013555:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013562:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013568:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050112.013572:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013580:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013605:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050112.013608:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050112.013614:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013620:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df578f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013634:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013640:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013646:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013651:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050112.013662:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013670:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013677:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:0.0:1789050112.013680:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050112.013683:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013688:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df578fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013728:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df578ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b24 expref: 59 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013742:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b24 expref: 58 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.013750:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050112.013752:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050112.013755:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779000, rc 0) 00000100:00100000:0.0:1789050112.013849:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+58:11293:x1875954704100480:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 815us (2942us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789050112.013858:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:2.0:1789050112.018385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.018462:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100736 00000100:00100000:1.0:1789050112.018473:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100736 00000100:00100000:1.0:1789050112.018540:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:1.0:1789050112.018558:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+58:11293:x1875954704100736:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789050112.018622:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018639:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018652:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018684:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018693:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018700:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018706:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050112.018725:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018732:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018743:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050112.018746:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050112.018751:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.018758:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.018839:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+58:11293:x1875954704100736:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 282us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.018847:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:3.0:1789050112.023715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.023804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.026560:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100608 00000100:00100000:0.0:1789050112.026577:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100608 00000100:00100000:0.0:1789050112.026669:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789050112.026679:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:2403:x1875954704100608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050112.026715:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050112.026741:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b24 expref: 58 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.026761:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050112.026766:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050112.026835:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:2403:x1875954704100608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 158us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.026843:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789050112.028223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100992 00000100:00100000:1.0:1789050112.028235:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100992 00000100:00100000:1.0:1789050112.028399:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789050112.028419:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:11293:x1875954704100992:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050112.030155:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:11293:x1875954704100992:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1737us (6341us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789050112.030166:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789050112.147796:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050112.148087:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101248 00000100:00100000:2.0:1789050112.148107:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101248 00000100:00100000:2.0:1789050112.148232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:2.0:1789050112.148243:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+58:11311:x1875954704101248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789050112.148273:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050112.148295:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57917 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b2b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.148446:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df5791e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.148462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df5791e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.148475:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df5791e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050112.148489:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789050112.148607:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df57917 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b2b expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.148629:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df5791e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b2b expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.148638:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050112.148641:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789050112.148653:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695400, rc 0) 00000100:00100000:2.0:1789050112.148718:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+60:11311:x1875954704101248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 477us (932us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789050112.148725:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00010000:00010000:1.0:1789050112.169298:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050112.174360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.174537:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101376 00000100:00100000:3.0:1789050112.174547:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101376 00000100:00100000:3.0:1789050112.174614:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:3.0:1789050112.174626:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+60:11312:x1875954704101376:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050112.174651:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.174672:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5792c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b32 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174744:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174768:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174778:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050112.174818:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789050112.174821:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050112.174840:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174868:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df5792c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b32 expref: 62 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174895:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b32 expref: 61 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.174905:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050112.174908:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050112.174911:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050112.175537:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+61:11312:x1875954704101376:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 911us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.175546:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:3.0:1789050112.180231:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.180292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101760 00000100:00100000:0.0:1789050112.180301:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101760 00000100:00100000:0.0:1789050112.180389:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050112.180400:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+61:11312:x1875954704101760:12345-192.168.203.42@tcp:35:lfs.0 00000001:00080000:0.0:1789050112.180623:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000100:00100000:0.0:1789050112.180729:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+63:11312:x1875954704101760:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 331us (505us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789050112.180736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000020:00080000:0.0:1789050112.180740:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050112.182877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050112.182992:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101888 00000100:00100000:2.0:1789050112.183002:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101888 00000100:00100000:2.0:1789050112.183076:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789050112.183086:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+63:11312:x1875954704101888:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:2.0:1789050112.183101:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789050112.183133:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df578c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b16 expref: 63 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.183155:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df5791e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b2b expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.183169:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df577c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ad0 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.183180:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050112.183186:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050112.183236:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+60:11312:x1875954704101888:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 152us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050112.183243:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789050112.185345:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.185465:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102016 00000100:00100000:1.0:1789050112.185474:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102016 00000100:00100000:1.0:1789050112.185529:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:1.0:1789050112.185538:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+60:11312:x1875954704102016:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:1.0:1789050112.185677:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.185693:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.185704:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050112.186022:0:14070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050112.186171:0:14070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789050112.186267:0:14070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789050112.186349:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+60:11312:x1875954704102016:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 810us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.186358:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:3.0:1789050112.210091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.210498:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102144 00000100:00100000:1.0:1789050112.210508:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102144 00000100:00100000:1.0:1789050112.210573:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:1.0:1789050112.210585:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+60:11314:x1875954704102144:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050112.210604:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050112.210625:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57941 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210689:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210706:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210717:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210745:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210752:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210759:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210847:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210857:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.210864:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050112.210907:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789050112.210911:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050112.210992:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211004:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211013:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211019:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211038:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211043:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050112.211048:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211056:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211069:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050112.211073:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050112.211078:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.211085:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57948 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213488:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213509:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213516:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213522:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050112.213526:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213557:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213575:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:1.0:1789050112.213578:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050112.213583:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213589:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df5794f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213643:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57941 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213662:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.213669:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:1.0:1789050112.213671:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050112.213674:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6e00, rc 0) 00000100:00100000:1.0:1789050112.213755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+61:11314:x1875954704102144:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3171us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.213763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00000040:00080000:3.0:1789050112.618100:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050112.618110:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050112.618149:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789050112.618163:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050112.618311:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714667648:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789050112.618415:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa81254480 going to sleep for 11 seconds 00000040:00080000:1.0:1789050112.622881:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050112.629660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.629835:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102272 00000100:00100000:3.0:1789050112.629846:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102272 00000100:00100000:3.0:1789050112.629909:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:3.0:1789050112.629920:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704102272:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050112.629992:0:10357:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789050112.630114:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704102272:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 196us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.630123:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:1.0:1789050112.631596:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714667648:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789050112.643102:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.647410:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102400 00000100:00100000:0.0:1789050112.647428:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102400 00000100:00100000:0.0:1789050112.647846:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:0.0:1789050112.647861:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+61:11325:x1875954704102400:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789050112.647984:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648006:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648034:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648080:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648087:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648092:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648123:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648133:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648141:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050112.648193:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789050112.648198:0:14070:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050112.648211:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648222:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648228:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648261:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648268:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050112.648272:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648280:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648292:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:0.0:1789050112.648296:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050112.648300:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648307:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df5795d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648318:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648325:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648331:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648336:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050112.648339:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648357:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648366:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8baa9294f000) 00010000:00010000:0.0:1789050112.648368:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050112.648372:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648378:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57964 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648391:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648397:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648403:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648408:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050112.648411:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648417:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648424:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050112.648427:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050112.648430:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.648457:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df5796b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050112.648555:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+61:11325:x1875954704102400:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 696us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.648564:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:2.0:1789050112.656186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.656326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102656 00000100:00100000:3.0:1789050112.656340:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102656 00000100:00100000:3.0:1789050112.656412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:3.0:1789050112.656424:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+61:11325:x1875954704102656:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.656451:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.656476:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57972 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.656607:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.656624:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.656638:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050112.656662:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789050112.656744:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.656752:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657115:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657125:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050112.657129:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657139:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657152:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050112.657156:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050112.657305:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657315:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657377:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57972 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b40 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657389:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:3.0:1789050112.657392:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050112.657405:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57972 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b40 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.657416:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:3.0:1789050112.657494:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704102656:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1070us (1314us total) trans 4294967355 rc 301/301 00000100:00100000:3.0:1789050112.657502:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789050112.669856:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.670636:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102784 00000100:00100000:3.0:1789050112.670648:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102784 00000100:00100000:3.0:1789050112.670721:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:3.0:1789050112.670732:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704102784:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050112.670771:0:10357:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789050112.670893:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704102784:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 163us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.670900:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:2.0:1789050112.677566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.678444:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103040 00000100:00100000:3.0:1789050112.678455:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103040 00000100:00100000:3.0:1789050112.678514:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:3.0:1789050112.678527:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704103040:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.678552:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.678556:0:14070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789050112.678584:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57933 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b32 expref: 62 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.678600:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050112.678605:0:14070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050112.678618:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57987 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b47 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050112.679067:0:14070:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789050112.679211:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5798e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.679225:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5798e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.679311:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5798e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.679367:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57987 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b47 expref: 64 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.679383:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5798e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b47 expref: 63 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.679390:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb600) 00010000:00010000:3.0:1789050112.679393:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050112.679395:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:3.0:1789050112.679459:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+63:11325:x1875954704103040:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 934us (1902us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789050112.679466:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789050112.687608:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.687906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103296 00000100:00100000:3.0:1789050112.687918:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103296 00000100:00100000:3.0:1789050112.688064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:3.0:1789050112.688076:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+63:11325:x1875954704103296:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.688143:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050112.688186:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df5798e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b47 expref: 63 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688203:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb600) 00010000:00010000:3.0:1789050112.688218:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050112.688251:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688266:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688276:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688334:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688342:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688348:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688394:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688402:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688407:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688413:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050112.688423:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688431:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688440:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050112.688443:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050112.688447:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688453:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df5799c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688463:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688469:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688474:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688480:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050112.688483:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688490:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688497:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf52b7738 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.688499:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050112.688508:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.688515:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf52b7738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050112.688597:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704103296:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 521us (1001us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050112.688605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:0.0:1789050112.694578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.697160:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103424 00000100:00100000:3.0:1789050112.697176:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103424 00000100:00100000:3.0:1789050112.697245:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:3.0:1789050112.697256:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:11325:x1875954704103424:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.697279:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.697301:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b4e expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697337:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697352:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697364:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697476:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 64 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697495:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 63 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.697510:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.697513:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050112.697516:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:3.0:1789050112.697585:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+63:11325:x1875954704103424:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 330us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.697591:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:2.0:1789050112.711836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.712298:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103680 00000100:00100000:0.0:1789050112.712309:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103680 00000100:00100000:0.0:1789050112.712480:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:0.0:1789050112.712492:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+63:11325:x1875954704103680:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050112.712777:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.712797:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.712811:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050112.713161:0:14070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1789050112.713173:0:14070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334911234769ns, next at 335911232148ns, rc = 0 00000004:00010000:0.0:1789050112.713356:0:14070:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000f5b6fb2 reply state 00000000490e99a2 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.713373:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.713394:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:0.0:1789050112.713410:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789050112.713415:0:14070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050112.713562:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98244a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+65:11325:x1875954704103680:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 1069us (1732us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789050112.713581:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00000001:00080000:2.0:1789050112.720790:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1789050112.720803:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789050112.720873:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789050112.720887:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba98366da80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789050112.720892:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98243fd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba98366d0c0 00000020:00080000:2.0:1789050112.720895:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98243f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8baa91a9b800 00010000:00010000:2.0:1789050112.720964:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.720986:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.720994:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721001:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.721005:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721012:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721030:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8baaa1a0ea00) 00010000:00010000:2.0:1789050112.721033:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.721038:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721058:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df576fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721079:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721085:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.721091:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.721287:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714667776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789050112.721357:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050112.721442:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714667776 00000100:00100000:1.0:1789050112.721449:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714667776 00000100:00100000:1.0:1789050112.721493:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050112.721502:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875954714667776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789050112.721526:0:8434:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789050112.721554:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x18d3fb986da70dde, atime: 0x18d3fb9879fe510d, ctime: 0x18d3fb986da70dde, blocks: 0x8 00010000:00010000:1.0:1789050112.721561:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721576:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1789050112.721581:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050112.721588:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721602:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721611:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721619:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721633:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789050112.721766:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875954714667776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 266us (408us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789050112.721782:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789050112.721801:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789050112.721814:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050112.721820:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721828:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050112.721832:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721841:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721854:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721862:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e89f7bc/0x3b8ec5973df579bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.721878:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050112.721880:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050112.721882:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789050112.721910:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba9832c3b80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1789050112.721916:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714667776:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789050112.722250:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.722254:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722261:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722272:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050112.722275:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.722279:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722286:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df57703 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722301:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722306:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722319:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722325:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.722327:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722333:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722340:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaa1a0e500) 00010000:00010000:2.0:1789050112.722342:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.722345:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722350:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57742 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722365:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722371:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722377:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722382:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.722385:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722503:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722512:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050112.722515:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.722518:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722524:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df5784c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722537:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722542:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722548:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722553:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.722555:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.722560:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050112.722800:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050112.722813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714667904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789050112.722852:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050112.722892:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714667904 00000100:00100000:0.0:1789050112.722898:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714667904 00000100:00100000:0.0:1789050112.722932:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789050112.722977:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714667904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789050112.723125:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875954714667904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (272us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789050112.723132:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789050112.723151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789050112.723169:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba9832dd180/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789050112.723174:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714667904:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789050112.723285:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050112.723288:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.723293:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723311:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df5786f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723327:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723333:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723339:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723345:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.723348:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723354:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723361:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:2.0:1789050112.723363:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050112.723365:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723371:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df578b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723380:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723386:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723508:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723515:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.723519:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723526:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723535:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:2.0:1789050112.723537:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050112.723540:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.723546:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df579b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789050112.724022:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789050112.724215:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789050112.728425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.728751:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103808 00000100:00100000:1.0:1789050112.728762:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103808 00000100:00100000:1.0:1789050112.728835:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:1.0:1789050112.728846:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+12:11325:x1875954704103808:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050112.728873:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050112.728895:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.728994:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.729010:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.729031:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:1.0:1789050112.729034:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050112.729038:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:1.0:1789050112.729109:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:11325:x1875954704103808:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 254us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.729116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:1.0:1789050112.736070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.736300:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103936 00000100:00100000:3.0:1789050112.736310:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103936 00000100:00100000:3.0:1789050112.736362:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:3.0:1789050112.736370:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1875954704103936:12345-192.168.203.42@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789050112.736418:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:3.0:1789050112.736452:0:8434:0:(genops.c:1384:class_connect()) connect: client 615c64c6-0403-4edc-8952-4a12704f5533, cookie 0x3b8ec5973df579cd 00002000:00100000:3.0:1789050112.736465:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 615c64c6-0403-4edc-8952-4a12704f5533/ffff8baaae9e9800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789050112.736483:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1789050112.736554:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789050112.736585:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8baaae9ed000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050112.736647:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2402:x1875954704103936:12345-192.168.203.42@tcp:8:lhsmtool_posix.0 Request processed in 276us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.736655:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789050112.748711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.753113:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104064 00000100:00100000:0.0:1789050112.753127:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104064 00000100:00100000:0.0:1789050112.753191:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789050112.753201:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:0:x1875954704104064:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789050112.753502:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789050112.755115:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00100000:2.0:1789050112.755127:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000001:00080000:2.0:1789050112.755134:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789050112.755346:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:0:x1875954704104064:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 2140us (6640us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789050112.755366:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:2.0:1789050112.764900:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.764986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104320 00000100:00100000:3.0:1789050112.764997:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104320 00000100:00100000:3.0:1789050112.765061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789050112.765071:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:11325:x1875954704104320:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050112.765434:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+14:11325:x1875954704104320:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 363us (541us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789050112.765443:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:2.0:1789050112.770257:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.770315:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104576 00000100:00100000:0.0:1789050112.770326:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104576 00000100:00100000:0.0:1789050112.770387:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:0.0:1789050112.770398:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+14:11325:x1875954704104576:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789050112.770511:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+14:11325:x1875954704104576:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.770519:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:2.0:1789050112.779230:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.779353:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104704 00000100:00100000:3.0:1789050112.779366:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104704 00000100:00100000:3.0:1789050112.779435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:3.0:1789050112.779447:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+14:11325:x1875954704104704:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.779468:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.779492:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779585:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779601:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779616:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050112.779664:0:6519:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050112.779683:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779711:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df579d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b5c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779730:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b5c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.779751:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.779754:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789050112.779758:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:3.0:1789050112.779825:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704104704:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 380us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.779832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:2.0:1789050112.789085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.789311:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104832 00000100:00100000:3.0:1789050112.789321:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104832 00000100:00100000:3.0:1789050112.789389:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:3.0:1789050112.789400:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704104832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.789419:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050112.789444:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b63 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050112.789469:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb990e051100, blocks: 0x0 00010000:00010000:3.0:1789050112.789488:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1789050112.789493:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050112.789502:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.789523:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.789537:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177600, rc 0) 00000100:00100000:3.0:1789050112.789595:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704104832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 197us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.789603:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:2.0:1789050112.802657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.802735:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105088 00000100:00100000:1.0:1789050112.802745:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105088 00000100:00100000:1.0:1789050112.802798:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:1.0:1789050112.802808:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704105088:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789050112.802914:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704105088:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.802921:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:3.0:1789050112.806482:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.806574:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105216 00000100:00100000:0.0:1789050112.806585:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105216 00000100:00100000:0.0:1789050112.806643:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789050112.806653:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:11325:x1875954704105216:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050112.806671:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050112.806689:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b6a expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.806722:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.806732:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789050112.806737:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050112.806743:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.806778:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.806806:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050112.806822:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875954714668032:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050112.806925:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050112.815211:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875954714668032:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050112.815252:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.815276:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779800, rc 0) 00000100:00100000:2.0:1789050112.815376:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:11325:x1875954704105216:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 8723us (8903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050112.815385:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:1.0:1789050112.820177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050112.820452:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105344 00000100:00100000:2.0:1789050112.820464:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105344 00010000:00010000:2.0:1789050112.820509:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.820552:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:2.0:1789050112.820561:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704105344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050112.820576:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050112.820597:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.820609:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.820633:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138e5fb5/0x3b8ec5973df579e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b63 expref: 7 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.820662:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050112.820667:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050112.820675:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.820686:0:7460:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.820725:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.820741:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1875954714668160:192.168.203.42@tcp:105: 00000100:00100000:2.0:1789050112.820835:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baac216d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789050112.825522:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1875954714668160:192.168.203.42@tcp:105: 00010000:00010000:1.0:1789050112.825551:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050112.825613:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704105344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5052us (5445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.825624:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:1.0:1789050112.826723:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.826809:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105472 00000100:00100000:0.0:1789050112.826819:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105472 00002000:00100000:0.0:1789050112.826864:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8baaae709500 x1875954704105472/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:613/0 lens 504/0 e 0 to 0 dl 1789050123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050112.826875:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8baaae709500 with x1875954704105472 ext(0->8) 00002000:00010000:0.0:1789050112.826880:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8baaae709500 00000100:00100000:0.0:1789050112.826909:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:0.0:1789050112.826917:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704105472:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789050112.831199:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704105472:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 4270us (4467us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789050112.831213:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00002000:00100000:0.0:1789050112.831227:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8baaae709500 x1875954704105472/t4294967304(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:613/0 lens 504/448 e 0 to 0 dl 1789050123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050112.831238:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8baaae709500 with x1875954704105472 ext(0->8) 00002000:00010000:0.0:1789050112.831245:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8baaae709500 00000100:00100000:2.0:1789050112.835348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.838853:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105600 00000100:00100000:0.0:1789050112.838869:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105600 00000100:00100000:0.0:1789050112.838980:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789050112.839007:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704105600:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789050112.839548:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704105600:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 539us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.839557:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:2.0:1789050112.849442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.849770:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105728 00000100:00100000:3.0:1789050112.849780:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105728 00000100:00100000:3.0:1789050112.849834:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:3.0:1789050112.849844:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704105728:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789050112.855478:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:0.0:1789050112.856419:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704105728:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 6566us (6977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.856432:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:1.0:1789050112.874095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.874215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105984 00000100:00100000:3.0:1789050112.874227:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105984 00000100:00100000:3.0:1789050112.874296:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:3.0:1789050112.874307:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704105984:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050112.874364:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050112.874393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df579db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b5c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.874414:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.874419:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050112.874450:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.874464:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.874475:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050112.874592:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000079d56f97 reply state 00000000e69d0eb8 transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.874619:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.874626:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.874629:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050112.874632:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050112.874983:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+16:11325:x1875954704105984:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 629us (850us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789050112.874992:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:1.0:1789050112.879427:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.879511:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106112 00000100:00100000:0.0:1789050112.879522:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106112 00000100:00100000:0.0:1789050112.879582:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:0.0:1789050112.879591:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704106112:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789050112.879746:0:8432:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789050112.879750:0:8432:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789050110891000000 00002000:00010000:0.0:1789050112.879753:0:8432:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789050109295000000 00002000:00010000:0.0:1789050112.879756:0:8432:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789050111780000000 -> 1789050110891000000 00002000:00010000:0.0:1789050112.879759:0:8432:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789050112.879820:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704106112:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 229us (402us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789050112.879829:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:2.0:1789050112.891498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050112.891539:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106368 00000100:00100000:2.0:1789050112.891549:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106368 00000100:00100000:2.0:1789050112.891600:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:2.0:1789050112.891609:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:11325:x1875954704106368:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789050112.891684:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.891702:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 16 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.891718:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.891754:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 16 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.891768:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 16 pid: 10357 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.891784:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714668288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050112.891875:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baac216d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050112.901410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050112.901464:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714668288:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050112.901493:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.901520:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106496 00000100:00100000:2.0:1789050112.901526:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106496 00010000:00010000:2.0:1789050112.901557:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 17 pid: 10357 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.901587:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:2.0:1789050112.901595:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+17:2404:x1875954704106496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050112.901609:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050112.901615:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 17 pid: 10357 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901641:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 17 pid: 10357 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901663:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df579b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b4e expref: 17 pid: 10357 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901690:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:2.0:1789050112.901695:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901705:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901713:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901732:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050112.901771:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+16:2404:x1875954704106496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050112.901778:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00010000:00010000:2.0:1789050112.901809:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901816:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901853:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901869:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901877:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901883:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050112.901887:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901895:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901903:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:2.0:1789050112.901905:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789050112.901909:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.901915:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df579f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.901981:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704106368:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 10372us (10492us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789050112.901988:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:2.0:1789050112.912884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.917087:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106624 00000100:00100000:1.0:1789050112.917190:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106624 00000100:00100000:1.0:1789050112.917823:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:1.0:1789050112.917837:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704106624:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789050112.917889:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.917910:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.917919:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050112.917923:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050112.917928:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.918009:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.918024:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 7 pid: 8433 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.918048:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1875954714668416:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050112.918152:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050112.923960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050112.925356:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1875954714668416:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050112.925392:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.933884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106752 00000100:00100000:1.0:1789050112.933902:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106752 00010000:00010000:1.0:1789050112.933994:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 8 pid: 8433 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.934049:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789050112.934061:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704106752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050112.934079:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050112.934117:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 8 pid: 8433 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.934131:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 8 pid: 8433 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.934156:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017afd336/0x3b8ec5973df579e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b6a expref: 8 pid: 8433 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.934172:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050112.934177:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050112.934183:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.934205:0:6505:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.934379:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050112.934445:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704106752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 385us (10769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.934453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00010000:00010000:1.0:1789050112.935233:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935248:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935275:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935285:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935293:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935301:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050112.935305:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935330:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935348:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.935356:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df579fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.935446:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704106624:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 17611us (22570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050112.935454:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:3.0:1789050112.940533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050112.940613:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107008 00000100:00100000:1.0:1789050112.940622:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107008 00000100:00100000:1.0:1789050112.940702:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:1.0:1789050112.940712:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+15:11325:x1875954704107008:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789050112.940791:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.940809:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.940819:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.940856:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050112.940883:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 15 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.940899:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714668544:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050112.941014:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050112.956710:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.958933:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714668544:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050112.958993:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050112.959195:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107136 00000100:00100000:0.0:1789050112.959285:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107136 00010000:00010000:0.0:1789050112.959325:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050112.959408:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:0.0:1789050112.959419:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+16:2404:x1875954704107136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050112.959433:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050112.959440:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959453:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959476:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966af3 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959489:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:0.0:1789050112.959495:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959505:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959513:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.959539:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050112.959599:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+15:2404:x1875954704107136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 182us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050112.959617:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00010000:00010000:2.0:1789050112.962211:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962235:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962417:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962433:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962443:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962485:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050112.962501:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 15 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050112.962516:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714668672:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050112.962585:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050112.978992:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714668672:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050112.979024:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050112.984086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050112.984380:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107264 00000100:00100000:3.0:1789050112.984390:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107264 00010000:00010000:3.0:1789050112.984436:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050112.984475:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789050112.984484:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+16:2403:x1875954704107264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050112.984499:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050112.984505:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984518:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984552:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df579c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b55 expref: 16 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984568:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.984574:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984584:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984592:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.984656:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050112.984704:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+15:2403:x1875954704107264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 220us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.984711:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00010000:00010000:0.0:1789050112.985291:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050112.985302:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050112.985481:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:0.0:1789050112.985600:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000001:00080000:0.0:1789050112.985638:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:0.0:1789050112.985714:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714668800:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050112.985771:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050112.985856:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050112.990380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714668800 00000100:00100000:3.0:1789050112.991020:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714668800 00000100:00100000:3.0:1789050112.991492:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789050112.991505:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714668800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050112.991651:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714668800:12345-0@lo:1000:mdt00_003.0 Request processed in 150us (5879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050112.991658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789050112.995674:0:10357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789050112.995689:0:10357:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba9832dd180, transno 4294967302 00000100:00100000:3.0:1789050112.995749:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714668800:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789050112.995926:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00000100:00100000:3.0:1789050112.996050:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98368e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714668928:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050112.996130:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050112.996175:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050112.998008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714668928 00000100:00100000:2.0:1789050112.998022:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714668928 00000100:00100000:2.0:1789050112.998078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789050112.998088:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714668928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050112.998485:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10357:x1875954714668928:12345-0@lo:1000:mdt00_003.0 Request processed in 398us (2354us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789050112.998504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789050112.999304:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98368e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714668928:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789050112.999358:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999368:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999376:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999381:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050112.999385:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999405:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999421:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050112.999423:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050112.999428:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999434:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999464:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999478:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999485:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999491:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050112.999494:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999500:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999510:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050112.999512:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050112.999515:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999521:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df5793a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999543:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999556:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999566:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999600:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050112.999622:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 18 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050112.999637:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714669056:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050112.999712:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac5e9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050113.008224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050113.008622:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107392 00000100:00100000:3.0:1789050113.008633:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107392 00010000:00010000:3.0:1789050113.008694:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 19 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.008767:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:3.0:1789050113.008777:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:2403:x1875954704107392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050113.008791:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050113.008798:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 19 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.008811:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 19 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.008832:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050113.008837:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.008847:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.008867:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.008888:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050113.008994:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:2403:x1875954704107392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 218us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.009003:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00080000:0.0:1789050113.009105:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050113.009582:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57956 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b39 expref: 18 pid: 6518 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.009599:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714669056:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050113.009620:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009628:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009633:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009646:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009652:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009659:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009665:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050113.009677:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009686:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009696:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050113.009699:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050113.009703:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009710:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009721:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009727:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009732:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009737:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050113.009739:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009745:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009752:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa9294ff00) 00010000:00010000:3.0:1789050113.009755:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050113.009764:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.009770:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57a05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.010007:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+17:11325:x1875954704107008:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 69294us (69482us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789050113.010016:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 93 00000020:00080000:3.0:1789050113.010021:0:10357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789050113.012043:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050113.012051:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050113.012072:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789050113.012079:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050113.015223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.015296:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107648 00000100:00100000:0.0:1789050113.015306:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107648 00000100:00100000:0.0:1789050113.015360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050113.015370:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+17:11325:x1875954704107648:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050113.015610:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789050113.015641:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967365 00010000:00010000:0.0:1789050113.015673:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015691:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015718:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015726:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015733:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015740:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.015762:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050113.015844:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:11325:x1875954704107648:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 475us (630us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789050113.015852:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000020:00080000:0.0:1789050113.015857:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050113.021043:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050113.021058:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.021069:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050113.021073:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.021084:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.021103:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:1.0:1789050113.021106:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050113.021111:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.021118:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57a1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.021132:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050113.021134:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050113.021143:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050113.024671:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050113.024679:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050113.024702:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789050113.024709:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050113.129301:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714669184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050113.129379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050113.130152:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714669184 00000100:00100000:1.0:1789050113.130161:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714669184 00000100:00100000:1.0:1789050113.130205:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789050113.130214:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714669184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050113.130248:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789050113.130305:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714669184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.130312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789050113.130366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714669184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050113.139572:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.139650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107904 00000100:00100000:2.0:1789050113.139661:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107904 00000100:00100000:2.0:1789050113.139725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:2.0:1789050113.139735:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:11335:x1875954704107904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050113.139759:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050113.139781:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b71 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.139904:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df57a28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.139918:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df57a28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.139931:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df57a28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050113.139975:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789050113.140076:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b71 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.140094:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df57a28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b71 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.140104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050113.140107:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050113.140126:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695600, rc 0) 00000100:00100000:2.0:1789050113.140182:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:11335:x1875954704107904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 448us (620us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789050113.140190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:3.0:1789050113.143004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.143087:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108032 00000100:00100000:2.0:1789050113.143107:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108032 00000100:00100000:2.0:1789050113.143168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:2.0:1789050113.143180:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:11335:x1875954704108032:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789050113.143259:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143277:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143291:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143305:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143312:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143319:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143402:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143412:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143431:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050113.143481:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143495:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143502:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143509:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143516:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050113.143520:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143528:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143539:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050113.143542:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050113.143548:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143554:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57a36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143568:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143581:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143586:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143591:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050113.143594:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143600:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143608:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaae580900) 00010000:00010000:2.0:1789050113.143610:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050113.143613:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143618:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57a3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143633:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143639:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143646:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143651:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050113.143659:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143667:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143675:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baaae580200) 00010000:00010000:2.0:1789050113.143678:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050113.143681:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.143686:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050113.143760:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:11335:x1875954704108032:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 582us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050113.143768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:1.0:1789050113.193603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1789050113.193738:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050113.193758:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108288 00000100:00100000:3.0:1789050113.193768:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108288 00000100:00100000:3.0:1789050113.193842:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789050113.193853:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+21:11338:x1875954704108288:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050113.193873:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050113.193893:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57a4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b78 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194040:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194073:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194087:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194108:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194127:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194134:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194466:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194476:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194483:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050113.194494:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789050113.194568:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194576:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194582:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194594:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050113.194598:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194606:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194618:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050113.194621:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050113.194626:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194631:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57a52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194716:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194723:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194729:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194734:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050113.194737:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194744:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194762:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050113.194764:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050113.194767:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194774:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57a59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194885:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57a4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 24 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194899:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 23 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.194907:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050113.194910:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050113.194912:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176800, rc 0) 00000100:00100000:3.0:1789050113.195027:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+23:11338:x1875954704108288:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1174us (1435us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789050113.195035:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789050113.202491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.202610:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108416 00000100:00100000:1.0:1789050113.202633:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108416 00000100:00100000:1.0:1789050113.202693:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:1.0:1789050113.202705:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:11338:x1875954704108416:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789050113.202783:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202803:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202816:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202854:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202862:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202886:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202893:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050113.202908:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202917:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202931:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.202959:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050113.202974:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.202981:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.203076:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:11338:x1875954704108416:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 372us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.203093:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:2.0:1789050113.207409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.207486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108672 00000100:00100000:0.0:1789050113.207497:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108672 00000100:00100000:0.0:1789050113.207557:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789050113.207570:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:11338:x1875954704108672:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050113.207971:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+24:11338:x1875954704108672:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 393us (561us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789050113.207981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789050113.242676:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.242778:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108928 00000100:00100000:2.0:1789050113.242790:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108928 00000100:00100000:2.0:1789050113.242848:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:2.0:1789050113.242858:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+24:10863:x1875954704108928:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050113.242881:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050113.242902:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a75 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b7f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.243137:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.243155:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 25 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.243181:0:6520:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.243219:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 25 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.243234:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 25 pid: 13807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.243249:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714669312:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050113.243366:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa22b49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050113.246413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.246497:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109056 00000100:00100000:1.0:1789050113.246507:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109056 00010000:00010000:1.0:1789050113.246546:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 26 pid: 13807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.246593:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:1.0:1789050113.246604:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+26:2404:x1875954704109056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050113.246636:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050113.246643:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 26 pid: 13807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.246656:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 26 pid: 13807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.246678:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.246684:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.246693:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.246701:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.246721:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050113.246779:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+26:2404:x1875954704109056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.246788:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00010000:00010000:2.0:1789050113.247373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b78 expref: 25 pid: 13807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050113.247393:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714669312:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050113.247426:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.247435:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.247441:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050113.247460:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789050113.247596:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57a75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.247612:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.247620:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:2.0:1789050113.247623:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050113.247626:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779400, rc 0) 00000100:00100000:2.0:1789050113.247672:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+25:10863:x1875954704108928:12345-192.168.203.42@tcp:101:bash.0 Request processed in 4815us (5006us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789050113.247679:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:0.0:1789050113.250151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050113.250241:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109184 00000100:00100000:3.0:1789050113.250252:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109184 00000100:00100000:3.0:1789050113.250315:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:3.0:1789050113.250326:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+25:10863:x1875954704109184:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050113.250351:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050113.250472:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57a8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b86 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250521:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250535:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250547:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250645:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57a8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b86 expref: 27 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250662:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b86 expref: 26 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.250669:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050113.250672:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050113.250675:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043000, rc 0) 00000100:00100000:3.0:1789050113.250734:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+26:10863:x1875954704109184:12345-192.168.203.42@tcp:101:bash.0 Request processed in 411us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.250741:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:3.0:1789050113.254236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.254381:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109440 00000100:00100000:0.0:1789050113.254392:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109440 00000100:00100000:0.0:1789050113.254452:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:0.0:1789050113.254464:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+26:10863:x1875954704109440:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:0.0:1789050113.254723:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.254744:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.254757:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050113.255023:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000004:00010000:0.0:1789050113.255070:0:14070:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b9cebbb0 reply state 00000000c9f5ce48 transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.255083:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.255090:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:0.0:1789050113.255093:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050113.255097:0:14070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789050113.255286:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967372 00000100:00100000:0.0:1789050113.255441:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+30:10863:x1875954704109440:12345-192.168.203.42@tcp:36:bash.0 Request processed in 977us (1214us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789050113.255450:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000020:00080000:0.0:1789050113.255456:0:14070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789050113.257491:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050113.257563:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109568 00000100:00100000:3.0:1789050113.257572:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109568 00000100:00100000:3.0:1789050113.257687:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:3.0:1789050113.257698:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+30:10863:x1875954704109568:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050113.257722:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050113.257758:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b8d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.257818:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b8d expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.257834:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b8d expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.257855:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050113.257858:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050113.257861:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:3.0:1789050113.257922:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+31:10863:x1875954704109568:12345-192.168.203.42@tcp:101:bash.0 Request processed in 225us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.257929:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:0.0:1789050113.265287:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.265538:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109696 00000100:00100000:2.0:1789050113.265549:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109696 00000100:00100000:2.0:1789050113.265676:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:2.0:1789050113.265690:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:10863:x1875954704109696:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050113.265712:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050113.265738:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b94 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050113.265783:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb98d90800c0, atime: 0x18d3fb9879e6f9c0, ctime: 0x18d3fb98d90800c0, blocks: 0x8 00010000:00010000:2.0:1789050113.265807:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789050113.265812:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050113.265822:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.265840:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.265853:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695c00, rc 0) 00000100:00100000:2.0:1789050113.266498:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:10863:x1875954704109696:12345-192.168.203.42@tcp:101:bash.0 Request processed in 808us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050113.266508:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789050113.270178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.270441:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109824 00000100:00100000:1.0:1789050113.270452:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109824 00002000:00010000:1.0:1789050113.270493:0:8438:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789050113.270499:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983c4ed80 with x1875954704109824 ext(0->18446744073709551615) 00002000:00010000:1.0:1789050113.270512:0:8438:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983c4ed80. 00000100:00100000:1.0:1789050113.270548:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:1.0:1789050113.271200:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704109824:12345-192.168.203.42@tcp:10:bash.0 00002000:00010000:1.0:1789050113.271485:0:8438:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789050113.271489:0:8438:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789050110891000000 -> 1789050112330000000 00002000:00010000:1.0:1789050113.271492:0:8438:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789050109295000000 -> 1789050109295000000 00002000:00010000:1.0:1789050113.271494:0:8438:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789050110891000000 -> 1789050112330000000 00002000:00010000:1.0:1789050113.271497:0:8438:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789050113.271557:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704109824:12345-192.168.203.42@tcp:10:bash.0 Request processed in 998us (1388us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789050113.271565:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00002000:00010000:1.0:1789050113.271569:0:8438:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789050113.271572:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983c4ed80 with x1875954704109824 ext(0->18446744073709551615) 00002000:00010000:1.0:1789050113.271578:0:8438:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983c4ed80. 00000100:00100000:0.0:1789050113.348693:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.348732:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109952 00000100:00100000:0.0:1789050113.348742:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109952 00000100:00100000:0.0:1789050113.348812:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:0.0:1789050113.348822:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+31:11352:x1875954704109952:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:0.0:1789050113.348895:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.348913:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.348925:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.348970:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349002:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349011:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349090:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349100:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349107:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050113.349160:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349172:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349179:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349185:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349191:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.349196:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349204:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349224:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050113.349227:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050113.349233:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349239:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349252:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349259:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349264:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349270:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.349273:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349279:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349286:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baa9294f000) 00010000:00010000:0.0:1789050113.349288:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050113.349291:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349297:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57ab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349323:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349329:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349334:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349339:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.349342:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349349:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349356:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:0.0:1789050113.349358:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050113.349361:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.349367:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57abb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.349437:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+31:11352:x1875954704109952:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 615us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.349444:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:0.0:1789050113.397816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.397982:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110208 00000100:00100000:1.0:1789050113.397992:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110208 00000100:00100000:1.0:1789050113.398057:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:1.0:1789050113.398068:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+31:11355:x1875954704110208:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050113.398090:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050113.398115:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57ac2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398190:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398206:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398219:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398253:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398260:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398266:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398383:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398392:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398399:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050113.398410:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789050113.398489:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398498:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398505:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398512:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050113.398517:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398536:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398548:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050113.398552:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050113.398558:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398565:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57ac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398580:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398586:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398592:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398596:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050113.398599:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398604:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398611:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:1.0:1789050113.398613:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050113.398616:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398631:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57ad0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398671:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57ac2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b9b expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398685:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b9b expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.398693:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.398695:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789050113.398697:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571000, rc 0) 00000100:00100000:1.0:1789050113.398848:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+33:11355:x1875954704110208:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 781us (1040us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789050113.398856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:0.0:1789050113.405146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.405304:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110336 00000100:00100000:2.0:1789050113.405315:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110336 00000100:00100000:2.0:1789050113.405379:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:2.0:1789050113.405390:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+33:11355:x1875954704110336:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050113.405454:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.405471:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.405480:0:6520:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.405705:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.405720:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 33 pid: 6520 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050113.405735:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714669440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050113.405995:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050113.414251:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9837c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714669440:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050113.414287:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.415056:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.415268:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110592 00000100:00100000:2.0:1789050113.415276:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110592 00000100:00100000:2.0:1789050113.415322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:2.0:1789050113.415332:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+34:6174:x1875954704110592:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1789050113.415546:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967375 00000100:00100000:2.0:1789050113.415653:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+36:6174:x1875954704110592:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 321us (601us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789050113.415660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000020:00080000:2.0:1789050113.415665:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050113.418250:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.419112:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110720 00000100:00100000:1.0:1789050113.419127:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110720 00010000:00010000:1.0:1789050113.419185:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 36 pid: 6520 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.419228:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:1.0:1789050113.419239:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+36:2404:x1875954704110720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050113.419254:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050113.419261:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 36 pid: 6520 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419294:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 36 pid: 6520 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419316:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57a7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b7f expref: 36 pid: 6520 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419334:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.419339:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419348:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419356:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.419394:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050113.419456:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+35:2404:x1875954704110720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 218us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.419464:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00010000:00010000:0.0:1789050113.419875:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.419885:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.419977:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.419985:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.419991:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.419997:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.420002:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.420010:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.420021:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:0.0:1789050113.420024:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050113.420027:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.420033:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57ae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.420092:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+34:11355:x1875954704110336:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 14704us (14956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.420100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:3.0:1789050113.424343:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.424564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110976 00000100:00100000:2.0:1789050113.424574:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110976 00000100:00100000:2.0:1789050113.424630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789050113.424640:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+34:11355:x1875954704110976:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789050113.424881:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+35:11355:x1875954704110976:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 242us (549us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789050113.424889:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:3.0:1789050113.561566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.561680:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111232 00000100:00100000:0.0:1789050113.561700:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111232 00000100:00100000:0.0:1789050113.561777:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:0.0:1789050113.561788:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+35:11366:x1875954704111232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1789050113.561812:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050113.561833:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ba2 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.561908:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.561923:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.561986:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562004:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562011:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562018:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562125:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562135:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562159:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050113.562169:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789050113.562241:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562249:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562256:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562262:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.562266:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562274:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562286:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050113.562289:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050113.562294:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562301:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57af3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562314:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562320:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562331:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562337:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050113.562340:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562347:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562354:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baa9294f000) 00010000:00010000:0.0:1789050113.562356:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050113.562359:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562365:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57afa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562405:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57aec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba2 expref: 38 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562418:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba2 expref: 37 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.562426:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:0.0:1789050113.562428:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050113.562430:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779000, rc 0) 00000100:00100000:0.0:1789050113.562494:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+37:11366:x1875954704111232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 709us (938us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789050113.562511:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:3.0:1789050113.570080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.570249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111488 00000100:00100000:2.0:1789050113.570259:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111488 00000100:00100000:2.0:1789050113.570320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789050113.570330:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+37:11366:x1875954704111488:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1789050113.570599:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+38:11366:x1875954704111488:12345-192.168.203.42@tcp:35:cat.0 Request processed in 269us (529us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789050113.570607:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:3.0:1789050113.608035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.608245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111744 00000100:00100000:1.0:1789050113.608258:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111744 00000100:00100000:1.0:1789050113.608330:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:1.0:1789050113.608342:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+38:11367:x1875954704111744:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:1.0:1789050113.608408:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789050113.608438:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b8d expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608486:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba2 expref: 37 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608499:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b9b expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57a91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b86 expref: 35 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.608529:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050113.608551:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608565:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608575:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608588:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608595:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608602:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608714:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.608731:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050113.609548:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:1.0:1789050113.609608:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609620:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609628:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609635:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609641:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609647:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609905:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050113.609932:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609981:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609988:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.609994:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050113.609998:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610006:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610017:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:1.0:1789050113.610020:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789050113.610024:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610030:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570e00/0x3b8ec5973df57b1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610048:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610054:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610059:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610064:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050113.610074:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610080:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610089:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050113.610091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050113.610094:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610101:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df57b0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050113.610111:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000008f960279 reply state 0000000066e6bb6f transno 4294967380 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610123:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.610129:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:1.0:1789050113.610131:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789050113.610134:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050113.610221:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+36:11367:x1875954704111744:12345-192.168.203.42@tcp:36:rm.0 Request processed in 1880us (2193us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789050113.610230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 106 00010000:00010000:2.0:1789050113.611867:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050113.611883:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.611893:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050113.611898:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.611907:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.611924:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:2.0:1789050113.611927:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789050113.611931:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.612068:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df57b24 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.612177:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050113.612179:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050113.612180:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050113.641375:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714669568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050113.641448:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050113.649895:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714669568 00000100:00100000:2.0:1789050113.649909:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714669568 00000100:00100000:2.0:1789050113.650003:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789050113.650013:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714669568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050113.650050:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789050113.650367:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714669568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 355us (8917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.650376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789050113.650472:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714669568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050113.697995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.698418:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112000 00000100:00100000:2.0:1789050113.698428:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112000 00000100:00100000:2.0:1789050113.698492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 107 00000100:00100000:2.0:1789050113.698502:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+36:11373:x1875954704112000:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050113.698525:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050113.698546:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57b2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ba9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698644:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698669:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698679:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698687:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.698707:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050113.699067:0:6518:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789050113.699566:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699579:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699588:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699622:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699629:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699637:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699642:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050113.699646:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699653:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699664:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050113.699667:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050113.699682:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699689:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df57b32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050113.699705:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000609d95e1 reply state 00000000c44d46a3 transno 4294967381 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699716:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699723:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:2.0:1789050113.699726:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050113.699729:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050113.699759:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57b2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699773:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.699780:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:2.0:1789050113.699782:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050113.699784:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695e00, rc 0) 00000100:00100000:2.0:1789050113.699866:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+39:11373:x1875954704112000:12345-192.168.203.42@tcp:101:bash.0 Request processed in 1356us (1920us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789050113.699874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 107 00000100:00100000:3.0:1789050113.702846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.702990:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112128 00000100:00100000:0.0:1789050113.703001:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112128 00000100:00100000:0.0:1789050113.703076:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:0.0:1789050113.703086:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704112128:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050113.703113:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050113.703134:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bb0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050113.703158:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050113.703178:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1789050113.703183:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050113.703192:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.703209:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.703223:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778600, rc 0) 00000100:00100000:0.0:1789050113.703289:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704112128:12345-192.168.203.42@tcp:101:bash.0 Request processed in 205us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.703297:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00080000:3.0:1789050113.703401:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050113.711251:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.711397:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112256 00000100:00100000:1.0:1789050113.711410:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112256 00000100:00100000:1.0:1789050113.711470:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:1.0:1789050113.711480:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:11373:x1875954704112256:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789050113.711497:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050113.711530:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bb7 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.711562:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.711571:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050113.711575:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050113.711580:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.711615:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.711629:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 9 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.711644:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714669696:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050113.711743:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050113.716306:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050113.716638:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112384 00000100:00100000:3.0:1789050113.716648:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112384 00010000:00010000:3.0:1789050113.716691:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 10 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.716745:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:3.0:1789050113.716756:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+10:2403:x1875954704112384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050113.716771:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050113.716794:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 10 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.716808:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 10 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.716834:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050113.716839:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050113.716848:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.716857:0:6503:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.716906:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.716923:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1875954714669824:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789050113.717060:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac5e9900 going to sleep for 11 seconds 00010000:00010000:2.0:1789050113.717790:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5799ac7/0x3b8ec5973df57b4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb0 expref: 10 pid: 8434 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050113.717825:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714669696:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050113.717851:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050113.717993:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570e00, rc 0) 00000100:00100000:3.0:1789050113.724049:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+9:11373:x1875954704112256:12345-192.168.203.42@tcp:101:bash.0 Request processed in 12555us (12794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.724063:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:3.0:1789050113.724348:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1875954714669824:192.168.203.42@tcp:105: 00010000:00010000:3.0:1789050113.724372:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050113.724474:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704112384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7719us (8177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050113.724484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:0.0:1789050113.727661:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050113.727898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112640 00000100:00100000:2.0:1789050113.727908:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112640 00000100:00100000:2.0:1789050113.728107:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:2.0:1789050113.728119:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+39:11373:x1875954704112640:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:2.0:1789050113.728323:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000100:00100000:2.0:1789050113.728453:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+41:11373:x1875954704112640:12345-192.168.203.42@tcp:35:bash.0 Request processed in 336us (802us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789050113.730169:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000020:00080000:2.0:1789050113.730178:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050113.913699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.916177:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112768 00000100:00100000:0.0:1789050113.916212:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112768 00000100:00100000:0.0:1789050113.916418:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 108 00000100:00100000:0.0:1789050113.916430:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+41:11389:x1875954704112768:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050113.916456:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050113.916478:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bbe expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916586:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916601:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916617:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050113.916681:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789050113.916686:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050113.916709:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916741:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bbe expref: 43 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916764:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bbe expref: 42 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.916775:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050113.916778:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050113.916782:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778600, rc 0) 00000100:00100000:0.0:1789050113.917154:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+42:11389:x1875954704112768:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 723us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.917163:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 108 00000100:00100000:3.0:1789050113.931555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.931723:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113024 00000100:00100000:0.0:1789050113.931732:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113024 00000100:00100000:0.0:1789050113.931796:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:0.0:1789050113.931807:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+42:11389:x1875954704113024:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050113.931827:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050113.931849:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bc5 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.932007:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57b71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.932022:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.932035:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050113.932046:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789050113.932627:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57b6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bc5 expref: 45 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.932646:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57b71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bc5 expref: 44 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.932656:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:0.0:1789050113.932659:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050113.932679:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779400, rc 0) 00000100:00100000:0.0:1789050113.932798:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+44:11389:x1875954704113024:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 990us (1253us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1789050113.932807:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:3.0:1789050113.936885:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.937202:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113152 00000100:00100000:1.0:1789050113.937212:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113152 00000100:00100000:1.0:1789050113.937297:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789050113.937308:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+44:2406:x1875954704113152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050113.937326:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050113.937352:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57b71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bc5 expref: 44 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.937387:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:1.0:1789050113.937398:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050113.937565:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+43:2406:x1875954704113152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 259us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.937572:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789050113.938360:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.938558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113408 00000100:00100000:0.0:1789050113.938565:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113408 00000100:00100000:0.0:1789050113.938613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:0.0:1789050113.938622:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+43:11389:x1875954704113408:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050113.938643:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050113.938660:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57b7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.938761:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.938775:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.938785:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050113.938797:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789050113.938903:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57b7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bcc expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.938921:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bcc expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.938979:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:0.0:1789050113.938993:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789050113.938996:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779000, rc 0) 00000100:00100000:0.0:1789050113.939048:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+45:11389:x1875954704113408:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 427us (690us total) trans 4294967385 rc 0/0 00000100:00100000:0.0:1789050113.939054:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:3.0:1789050113.954129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.954304:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113536 00000100:00100000:1.0:1789050113.954314:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113536 00000100:00100000:1.0:1789050113.954379:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:1.0:1789050113.954390:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704113536:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1789050113.955022:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.955046:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.955054:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789050113.955059:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050113.955064:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.955099:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.955114:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 8 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.955151:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1875954714669952:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050113.955519:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050113.967932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.968182:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113664 00000100:00100000:0.0:1789050113.968191:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113664 00002000:00100000:0.0:1789050113.968253:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8baab77d5c00 x1875954704113664/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:614/0 lens 504/0 e 0 to 0 dl 1789050124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050113.968265:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8baab77d5c00 with x1875954704113664 ext(0->8) 00010000:00010000:0.0:1789050113.968274:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 9 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.968291:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 9 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050113.968299:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8baab77d5c00 00000100:00100000:0.0:1789050113.968336:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:0.0:1789050113.968345:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704113664:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:0.0:1789050113.969543:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+11:2403:x1875954704113664:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 1191us (1614us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789050113.969555:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00002000:00100000:0.0:1789050113.969567:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8baab77d5c00 x1875954704113664/t4294967303(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:614/0 lens 504/448 e 0 to 0 dl 1789050124 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050113.969577:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8baab77d5c00 with x1875954704113664 ext(0->8) 00010000:00010000:0.0:1789050113.969594:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 11 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.969609:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 11 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050113.969617:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8baab77d5c00 00000100:00100000:3.0:1789050113.974055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.974205:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113792 00000100:00100000:0.0:1789050113.974366:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113792 00010000:00010000:0.0:1789050113.974423:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 11 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.974475:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789050113.974486:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+11:2404:x1875954704113792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050113.974505:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789050113.974525:0:7461:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789050113.974527:0:7461:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789050112805011848 00002000:00010000:0.0:1789050113.974530:0:7461:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789050113027902399 00002000:00010000:0.0:1789050113.974532:0:7461:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789050112805011848 00002000:00010000:0.0:1789050113.974534:0:7461:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789050113.974541:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 11 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.974554:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 11 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.974581:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050113.974602:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050113.974609:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.974619:0:7461:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.974641:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050113.974691:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+11:2404:x1875954704113792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 207us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.974699:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00010000:00010000:1.0:1789050113.977572:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57b55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bb7 expref: 10 pid: 8433 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.977597:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1875954714669952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050113.977623:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977636:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977643:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977676:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977684:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977693:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977725:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050113.977729:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977738:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977758:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.977765:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413728f7/0x3b8ec5973df57b94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.977857:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704113536:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 23468us (23735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050113.977866:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:3.0:1789050113.982765:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050113.982838:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114048 00000100:00100000:1.0:1789050113.982848:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114048 00000100:00100000:1.0:1789050113.982912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789050113.982920:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+45:11389:x1875954704114048:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:1.0:1789050113.983030:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bcc expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050113.983209:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:1.0:1789050113.983250:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000001:00080000:1.0:1789050113.984055:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789050113.984092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.984108:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.984117:0:6521:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.984153:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050113.984166:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 49 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050113.984180:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714670080:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050113.984413:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050113.987838:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9825cf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714670080:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050113.987874:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.989702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050113.990922:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114176 00000100:00100000:0.0:1789050113.991011:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114176 00010000:00010000:0.0:1789050113.991061:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 50 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050113.991201:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:0.0:1789050113.991213:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+50:2404:x1875954704114176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050113.991240:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050113.991248:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 50 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991263:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 50 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991287:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57b40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ba9 expref: 50 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991327:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:0.0:1789050113.991334:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991344:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991352:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050113.991396:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050113.991475:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+49:2404:x1875954704114176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 265us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050113.991482:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00010000:00010000:3.0:1789050113.992108:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.992118:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050113.992235:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00000001:00080000:3.0:1789050113.992353:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00000100:00100000:3.0:1789050113.992466:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714670208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789050113.992520:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050113.992558:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050113.992676:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714670208 00000100:00100000:2.0:1789050113.992684:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714670208 00000100:00100000:2.0:1789050113.992726:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789050113.992735:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1875954714670208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050113.992810:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1875954714670208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050113.992816:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789050113.993198:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714670208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789050113.993342:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00000100:00100000:3.0:1789050113.993395:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714670336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789050113.993566:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050113.993636:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac5e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050113.995063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714670336 00000100:00100000:2.0:1789050113.995163:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714670336 00000100:00100000:2.0:1789050113.995327:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789050113.995339:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1875954714670336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050113.995576:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1875954714670336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 240us (2010us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789050113.995584:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789050113.995663:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714670336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789050113.995729:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967392 00010000:00010000:3.0:1789050113.995770:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995781:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995789:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995795:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050113.995800:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995807:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995822:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:3.0:1789050113.995825:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789050113.995830:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050113.995837:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570000/0x3b8ec5973df57b9b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050113.995975:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789050113.996056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789050113.996070:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336194131972ns, next at 337194129395ns, rc = 0 00000001:00080000:3.0:1789050113.996076:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00010000:00010000:3.0:1789050113.996110:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580e00) 00010000:00010000:3.0:1789050113.996113:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789050113.996121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57b86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bcc expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050113.996231:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+52:11389:x1875954704114048:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 13311us (13476us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789050113.996240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000020:00080000:3.0:1789050113.996245:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789050114.001502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050114.001980:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114304 00000100:00100000:2.0:1789050114.001990:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114304 00000100:00100000:2.0:1789050114.002052:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 111 00000100:00100000:2.0:1789050114.002062:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+52:11389:x1875954704114304:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050114.002095:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050114.002118:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57ba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bd3 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.003565:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bd3 expref: 53 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.003587:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bd3 expref: 53 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.003611:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.003614:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050114.003618:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694000, rc 0) 00000100:00100000:2.0:1789050114.003687:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+53:11389:x1875954704114304:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1625us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050114.003695:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 111 00000100:00100000:0.0:1789050114.013150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050114.013641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114560 00000100:00100000:2.0:1789050114.013667:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114560 00000100:00100000:2.0:1789050114.013736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:2.0:1789050114.013747:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+53:11389:x1875954704114560:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789050114.014030:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+54:11389:x1875954704114560:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 284us (890us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789050114.014039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:3.0:1789050114.132896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050114.133096:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114688 00000100:00100000:1.0:1789050114.133106:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114688 00000100:00100000:1.0:1789050114.133166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00100000:1.0:1789050114.133176:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+54:11399:x1875954704114688:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:1.0:1789050114.133330:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050114.133359:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050114.133368:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050114.133377:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050114.133382:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050114.133386:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134550:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134564:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134572:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050114.134627:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134665:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134673:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134680:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134698:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050114.134707:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134716:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134728:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050114.134731:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050114.134736:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134742:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57ba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134757:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134762:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134768:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134772:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050114.134774:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134780:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:3.0:1789050114.134801:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050114.134804:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134809:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570600/0x3b8ec5973df57bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134819:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134824:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134829:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134834:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050114.134836:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134842:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134848:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050114.134850:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050114.134853:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.134858:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57bb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.136110:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+54:11399:x1875954704114688:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 2925us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050114.136122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00100000:1.0:1789050114.178095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.178183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114944 00000100:00100000:0.0:1789050114.178193:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114944 00000100:00100000:0.0:1789050114.178266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:0.0:1789050114.178277:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+54:11402:x1875954704114944:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050114.178297:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.178318:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178387:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178401:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178542:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178563:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178569:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178678:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178686:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178693:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050114.178703:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789050114.178778:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178786:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178794:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178800:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050114.178812:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178821:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178834:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050114.178836:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050114.178842:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178848:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57bc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178860:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178867:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178873:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178878:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050114.178880:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178886:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178893:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:0.0:1789050114.178895:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050114.178904:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.178910:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.179004:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bda expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.179020:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bda expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.179027:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.179030:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050114.179033:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779400, rc 0) 00000100:00100000:0.0:1789050114.179142:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+56:11402:x1875954704114944:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 868us (1059us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789050114.179149:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:1.0:1789050114.195150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.195360:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115072 00000100:00100000:0.0:1789050114.195370:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115072 00000100:00100000:0.0:1789050114.195561:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:0.0:1789050114.195572:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9825cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+56:11402:x1875954704115072:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789050114.195637:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195655:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195668:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195722:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195728:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195734:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195740:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050114.195744:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195750:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195762:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.195765:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050114.195769:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.195775:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050114.195850:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9825cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+56:11402:x1875954704115072:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 279us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.195857:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:1.0:1789050114.215820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050114.216263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115328 00000100:00100000:3.0:1789050114.216274:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115328 00000100:00100000:3.0:1789050114.216340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789050114.216351:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+56:11402:x1875954704115328:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050114.216615:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:11402:x1875954704115328:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 265us (805us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789050114.216623:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:1.0:1789050114.219897:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050114.344122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.344281:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115584 00000100:00100000:0.0:1789050114.344292:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115584 00000100:00100000:0.0:1789050114.344364:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:0.0:1789050114.344388:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+57:11412:x1875954704115584:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050114.344411:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.344414:0:14070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050114.344438:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57b63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bbe expref: 57 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.344455:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050114.344460:0:14070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050114.344472:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966be1 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.344572:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.344586:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.344595:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050114.344605:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789050114.348114:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57be8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be1 expref: 59 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.348139:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be1 expref: 58 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.348148:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.348151:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050114.348173:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae779800, rc 0) 00000100:00100000:0.0:1789050114.348251:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+58:11412:x1875954704115584:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3864us (4138us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789050114.348260:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:1.0:1789050114.358649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050114.358767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.358911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115840 00000100:00100000:0.0:1789050114.358922:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115840 00000100:00100000:0.0:1789050114.359035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:0.0:1789050114.359047:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+58:11412:x1875954704115840:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050114.359071:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.359092:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966be8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359128:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359143:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359156:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359281:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778200/0x3b8ec5973df57bfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359300:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.359308:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.359311:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050114.359323:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae778600, rc 0) 00000100:00100000:0.0:1789050114.359374:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+59:11412:x1875954704115840:12345-192.168.203.42@tcp:101:bash.0 Request processed in 329us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.359381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:2.0:1789050114.359507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115712 00000100:00100000:2.0:1789050114.359512:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115712 00000100:00100000:2.0:1789050114.359553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789050114.359560:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+59:2403:x1875954704115712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050114.359569:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050114.359582:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779800/0x3b8ec5973df57bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be1 expref: 59 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.359592:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.359595:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050114.359627:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+58:2403:x1875954704115712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 69us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050114.359633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789050114.363659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050114.364189:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116096 00000100:00100000:2.0:1789050114.364201:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116096 00000100:00100000:2.0:1789050114.364264:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:2.0:1789050114.364274:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+58:11412:x1875954704116096:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:2.0:1789050114.364327:0:13807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050114.364359:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779400/0x3b8ec5973df57bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bda expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.364399:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.364404:0:13807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050114.364583:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.364598:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.364608:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050114.364654:0:13807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967399 00000004:00010000:2.0:1789050114.364680:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000320607bc reply state 0000000096736273 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.364706:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.364712:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.364715:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050114.364718:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050114.364886:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+60:11412:x1875954704116096:12345-192.168.203.42@tcp:36:bash.0 Request processed in 611us (1238us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789050114.364893:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 117 00000020:00080000:2.0:1789050114.364897:0:13807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050114.367382:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.367649:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116224 00000100:00100000:0.0:1789050114.367658:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116224 00000100:00100000:0.0:1789050114.367830:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:0.0:1789050114.367841:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+60:11412:x1875954704116224:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050114.367864:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.367887:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bef expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368044:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368059:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368071:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050114.368115:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789050114.368120:0:14070:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050114.368140:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368168:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779000/0x3b8ec5973df57c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 62 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368187:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 61 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.368204:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.368207:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050114.368211:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1e00, rc 0) 00000100:00100000:0.0:1789050114.368274:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+61:11412:x1875954704116224:12345-192.168.203.42@tcp:101:bash.0 Request processed in 434us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.368290:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:1.0:1789050114.373217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050114.378573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116480 00000100:00100000:3.0:1789050114.378591:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116480 00000100:00100000:3.0:1789050114.378719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:3.0:1789050114.378729:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+61:11412:x1875954704116480:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:3.0:1789050114.378989:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+62:11412:x1875954704116480:12345-192.168.203.42@tcp:35:bash.0 Request processed in 260us (5786us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789050114.378996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789050114.470713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.471019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116608 00000100:00100000:0.0:1789050114.471029:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116608 00000100:00100000:0.0:1789050114.471101:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:0.0:1789050114.471112:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+62:11418:x1875954704116608:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050114.471136:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.471156:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471220:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471234:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471245:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050114.471296:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789050114.471300:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050114.471319:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471366:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bf6 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471384:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bf6 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.471393:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050114.471396:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050114.471400:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0800, rc 0) 00000100:00100000:0.0:1789050114.471454:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704116608:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 345us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.471460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:1.0:1789050114.475861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050114.475990:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116736 00000100:00100000:2.0:1789050114.476001:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116736 00000100:00100000:2.0:1789050114.476055:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:2.0:1789050114.476066:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704116736:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050114.476108:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050114.476131:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57c2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966bfd expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476198:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476224:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476241:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476257:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476265:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476271:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476348:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476357:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476363:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050114.476402:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789050114.476412:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050114.476575:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476589:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476597:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476605:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476612:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476619:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050114.476624:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476631:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476644:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:2.0:1789050114.476647:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050114.476652:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476659:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57c35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476672:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476688:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476694:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476699:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050114.476702:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476709:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476718:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:2.0:1789050114.476721:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050114.476723:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.476729:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57c3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.478846:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57c2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.478883:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 64 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.478891:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.478894:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050114.478918:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695a00, rc 0) 00000100:00100000:2.0:1789050114.479008:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+64:11418:x1875954704116736:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2941us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050114.479017:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:1.0:1789050114.484603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050114.484792:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116992 00000100:00100000:3.0:1789050114.484803:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116992 00000100:00100000:3.0:1789050114.484871:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:3.0:1789050114.484881:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+64:11418:x1875954704116992:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050114.484902:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050114.484921:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486246:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486270:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486279:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486287:0:6519:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486327:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486343:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.486359:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714670464:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050114.486478:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.486489:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.486499:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714670592:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050114.488794:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88693000 going to sleep for 11 seconds 00000100:00100000:1.0:1789050114.491710:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050114.492167:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117120 00000100:00100000:3.0:1789050114.492178:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117120 00010000:00010000:3.0:1789050114.492216:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 66 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.492260:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:3.0:1789050114.492270:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+66:2406:x1875954704117120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050114.492285:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050114.492293:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 66 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.492305:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 66 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.492329:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050114.492335:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.492345:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.492351:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050114.492421:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+66:2406:x1875954704117120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 152us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050114.492429:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00010000:00010000:3.0:1789050114.492810:0:6519:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from blocking AST (req@00000000fb01e58c x1875954714670464) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.492845:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57c43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bfd expref: 65 pid: 13807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.492861:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714670464:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050114.499278:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714670592:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050114.499311:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050114.499318:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.499329:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.499338:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050114.503495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050114.503594:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117248 00000100:00100000:3.0:1789050114.503612:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117248 00010000:00010000:3.0:1789050114.503650:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050114.503702:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:3.0:1789050114.503712:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+65:2404:x1875954704117248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050114.503727:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050114.503734:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503768:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503791:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df57c19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bef expref: 65 pid: 14070 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503809:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050114.503814:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503823:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503831:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050114.503865:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050114.503923:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+64:2404:x1875954704117248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 212us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050114.503931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00010000:00010000:0.0:1789050114.504601:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.504611:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050114.504630:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789050114.504770:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.504789:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.504798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.504810:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050114.504813:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:0.0:1789050114.504858:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+64:11418:x1875954704116992:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 19977us (20264us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789050114.504866:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:0.0:1789050114.509015:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050114.509192:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117504 00000100:00100000:2.0:1789050114.509202:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117504 00000100:00100000:2.0:1789050114.509274:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789050114.509284:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+64:11418:x1875954704117504:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:2.0:1789050114.509299:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050114.509325:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57ba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bd3 expref: 64 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050114.509344:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050114.509349:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050114.509409:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704117504:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 126us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050114.509417:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789050114.517738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.517990:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117632 00000100:00100000:0.0:1789050114.518001:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117632 00000100:00100000:0.0:1789050114.518063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:0.0:1789050114.518082:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704117632:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:0.0:1789050114.518195:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.518212:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.518224:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050114.518310:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789050114.518381:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704117632:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 309us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.518388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:1.0:1789050114.531495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050114.531686:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117760 00000100:00100000:0.0:1789050114.531696:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117760 00000100:00100000:0.0:1789050114.531752:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:0.0:1789050114.531759:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+63:11418:x1875954704117760:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050114.531775:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050114.531808:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c0b expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531861:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531874:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 64 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531893:0:10357:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531906:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 64 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531920:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050114.531922:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050114.531925:0:10357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 64 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050114.531933:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0e00, rc 0) 00000100:00100000:0.0:1789050114.532144:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+64:11418:x1875954704117760:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 384us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050114.532152:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 123 00000040:00080000:0.0:1789050115.049202:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050115.049212:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050115.049273:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789050115.049629:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050115.049789:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714670720:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050115.050038:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050115.056260:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9835f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714670720:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050115.060777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.061440:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117888 00000100:00100000:1.0:1789050115.061452:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117888 00000100:00100000:1.0:1789050115.061588:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:1.0:1789050115.061599:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+64:11419:x1875954704117888:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050115.061642:0:14070:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050115.061794:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+64:11419:x1875954704117888:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 196us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.061803:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00080000:3.0:1789050115.063729:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050115.080492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.080792:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118016 00000100:00100000:3.0:1789050115.080804:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118016 00000100:00100000:3.0:1789050115.080915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:3.0:1789050115.080927:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+64:11419:x1875954704118016:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789050115.081034:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081072:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081087:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081103:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081110:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081117:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081160:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081167:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050115.081214:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789050115.081218:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050115.081231:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081242:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081258:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081265:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081271:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.081276:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081284:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081298:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:3.0:1789050115.081301:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.081306:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081312:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57c6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081326:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081331:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081337:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081343:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.081352:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081358:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081367:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050115.081369:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.081372:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081378:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57c74 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081398:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081403:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081409:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081413:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.081416:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081421:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081427:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050115.081429:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.081437:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.081443:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050115.081516:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+64:11419:x1875954704118016:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 591us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.081523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:2.0:1789050115.084037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.084215:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118272 00000100:00100000:0.0:1789050115.084225:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118272 00000100:00100000:0.0:1789050115.084285:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:0.0:1789050115.084295:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+64:11419:x1875954704118272:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.084315:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.084334:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57c82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c12 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084434:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084450:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084461:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050115.084473:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789050115.084555:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084563:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084570:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084576:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050115.084609:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084618:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084845:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050115.084849:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789050115.084923:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.084932:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.085092:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57c82 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c12 expref: 66 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.085104:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:0.0:1789050115.085107:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050115.085110:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57c82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c12 expref: 66 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.085119:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1200, rc 0) 00000100:00100000:0.0:1789050115.085288:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704118272:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 993us (1260us total) trans 4294967403 rc 301/301 00000100:00100000:0.0:1789050115.085297:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:2.0:1789050115.092581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.094988:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118400 00000100:00100000:1.0:1789050115.095004:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118400 00000100:00100000:1.0:1789050115.095090:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 127 00000100:00100000:1.0:1789050115.095100:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704118400:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050115.095149:0:14070:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050115.095275:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704118400:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 175us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.095283:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 127 00000100:00100000:1.0:1789050115.102005:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.102134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118656 00000100:00100000:0.0:1789050115.102153:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118656 00000100:00100000:0.0:1789050115.102213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:0.0:1789050115.102224:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704118656:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.102265:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.102268:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050115.102294:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57c27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966bf6 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.102312:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:0.0:1789050115.102317:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050115.102331:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57c97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050115.102760:0:6520:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789050115.102902:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.102918:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.102929:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.103486:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57c97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c19 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.103507:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c19 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.103526:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f300) 00010000:00010000:0.0:1789050115.103529:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050115.103546:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0c00, rc 0) 00000100:00100000:0.0:1789050115.103616:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+66:11419:x1875954704118656:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1394us (1620us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1789050115.103623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:2.0:1789050115.110501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.111816:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118912 00000100:00100000:3.0:1789050115.111831:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118912 00000100:00100000:3.0:1789050115.111905:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:3.0:1789050115.111916:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+66:11419:x1875954704118912:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050115.112133:0:10357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050115.112160:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df57c9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c19 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112179:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f300) 00010000:00010000:3.0:1789050115.112188:0:10357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050115.112210:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112223:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112232:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112283:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112309:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112317:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112362:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112369:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112376:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112382:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.112386:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112394:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112401:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050115.112404:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.112408:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112414:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57cac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112423:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112434:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112440:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112445:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.112448:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112455:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112462:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd8ff87dd (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050115.112465:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.112468:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.112474:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cb3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd8ff87dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050115.114319:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704118912:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 2392us (3814us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050115.114333:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:1.0:1789050115.121318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.121457:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119040 00000100:00100000:0.0:1789050115.121466:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119040 00000100:00100000:0.0:1789050115.121524:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:0.0:1789050115.121534:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+65:11419:x1875954704119040:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.121556:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.121581:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57cba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c20 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121615:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121629:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121640:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121926:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57cba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 67 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121982:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 66 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.121991:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:0.0:1789050115.121994:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050115.122006:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0800, rc 0) 00000100:00100000:0.0:1789050115.122068:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+66:11419:x1875954704119040:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 535us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.122077:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:1.0:1789050115.126181:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.126304:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119296 00000100:00100000:3.0:1789050115.126313:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119296 00000100:00100000:3.0:1789050115.126378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 131 00000100:00100000:3.0:1789050115.126397:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+66:11419:x1875954704119296:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050115.126478:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.126511:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.126522:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050115.126693:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789050115.126704:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337324765877ns, next at 338324763085ns, rc = 0 00000004:00010000:2.0:1789050115.134032:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000008d73bf1e reply state 0000000018ec45d3 transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.134187:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.134200:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:2.0:1789050115.134221:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789050115.134225:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050115.134371:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+68:11419:x1875954704119296:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 7972us (8194us total) trans 4294967405 rc 0/0 00000100:00100000:2.0:1789050115.134386:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 131 00000100:00100000:2.0:1789050115.139059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.139162:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119424 00000100:00100000:0.0:1789050115.139172:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119424 00000100:00100000:0.0:1789050115.139231:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:0.0:1789050115.139241:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+68:11419:x1875954704119424:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.139264:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.139284:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c27 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.139338:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 69 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.139352:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 69 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.139370:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:0.0:1789050115.139374:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050115.139377:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1200, rc 0) 00000100:00100000:0.0:1789050115.139434:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+69:11419:x1875954704119424:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 193us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.139441:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:1.0:1789050115.147811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.147921:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119552 00000100:00100000:2.0:1789050115.147934:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119552 00000100:00100000:2.0:1789050115.148066:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789050115.148077:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2405:x1875954704119552:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789050115.148372:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:2405:x1875954704119552:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 295us (569us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789050115.148381:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00080000:3.0:1789050115.149356:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050115.154776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.154894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119808 00000100:00100000:0.0:1789050115.154905:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119808 00000100:00100000:0.0:1789050115.155029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789050115.155039:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+69:11419:x1875954704119808:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050115.155268:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+70:11419:x1875954704119808:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 230us (503us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789050115.155276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789050115.168151:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.168289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120064 00000100:00100000:3.0:1789050115.168300:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120064 00000100:00100000:3.0:1789050115.168365:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:3.0:1789050115.168376:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+70:11419:x1875954704120064:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050115.168490:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+70:11419:x1875954704120064:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.168497:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:1.0:1789050115.171267:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.171390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120192 00000100:00100000:0.0:1789050115.171400:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120192 00000100:00100000:0.0:1789050115.171459:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:0.0:1789050115.171471:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+70:11419:x1875954704120192:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.171492:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.171513:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57cd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171584:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171600:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171614:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050115.171664:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050115.171686:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171711:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57cd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c2e expref: 72 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171730:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c2e expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.171755:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:0.0:1789050115.171758:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789050115.171762:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1800, rc 0) 00000100:00100000:0.0:1789050115.171824:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+71:11419:x1875954704120192:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 356us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.171832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:1.0:1789050115.176031:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.176238:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120320 00000100:00100000:0.0:1789050115.176249:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120320 00000100:00100000:0.0:1789050115.176315:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:0.0:1789050115.176325:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2406:x1875954704120320:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.176343:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050115.176375:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c35 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050115.176410:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb999e61da80, blocks: 0x0 00010000:00010000:0.0:1789050115.176431:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1789050115.176435:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050115.176445:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 10 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.176465:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 10 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.176480:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0200, rc 0) 00000100:00100000:0.0:1789050115.176552:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+10:2406:x1875954704120320:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 227us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.176559:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000004:00080000:0.0:1789050115.179647:0:8628:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337377707034ns, next at 338377704675ns, rc = 0 00000100:00100000:1.0:1789050115.181275:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714670976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050115.181365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.181438:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050115.181446:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714670848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050115.181469:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050115.182076:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714670976 00000100:00100000:3.0:1789050115.182085:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714670976 00000100:00100000:3.0:1789050115.182135:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714670848 00000100:00100000:3.0:1789050115.182139:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714670848 00000100:00100000:3.0:1789050115.182158:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789050115.182165:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714670976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050115.182189:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050115.182241:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714670976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.182247:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789050115.182266:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789050115.182280:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3647:x1875954714670848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050115.182290:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050115.182313:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3647:x1875954714670848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.182318:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789050115.182371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714670848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050115.182389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714670976:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789050115.182412:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050115.182739:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.182933:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120576 00000100:00100000:3.0:1789050115.182970:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120576 00000100:00100000:3.0:1789050115.183005:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00100000:3.0:1789050115.183012:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+71:11419:x1875954704120576:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789050115.186424:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+71:11419:x1875954704120576:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 3401us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.186439:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00100000:0.0:1789050115.196612:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.196692:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120704 00000100:00100000:2.0:1789050115.196703:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120704 00000100:00100000:2.0:1789050115.196760:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:2.0:1789050115.196769:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+10:11419:x1875954704120704:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050115.196786:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050115.196802:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c3c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.196832:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.196861:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050115.196865:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050115.196871:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.196901:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.196915:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.196976:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714671104:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050115.197062:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050115.200313:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714671104:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050115.200351:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.200373:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694800, rc 0) 00000100:00100000:2.0:1789050115.201093:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+11:11419:x1875954704120704:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 4321us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.201103:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:0.0:1789050115.205898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.206057:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120832 00000100:00100000:1.0:1789050115.206068:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120832 00010000:00010000:1.0:1789050115.206114:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.206160:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:1.0:1789050115.206170:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+11:2403:x1875954704120832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050115.206190:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050115.206224:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.206239:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.206262:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f180f46/0x3b8ec5973df57ce4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c35 expref: 11 pid: 8434 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.206279:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050115.206284:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050115.206292:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.206341:0:7460:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.206378:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.206394:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1875954714671232:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789050115.206481:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050115.215011:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1875954714671232:192.168.203.42@tcp:105: 00010000:00010000:1.0:1789050115.215042:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050115.215103:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+10:2403:x1875954704120832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8933us (9214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.215114:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:2.0:1789050115.217504:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.217640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120960 00000100:00100000:1.0:1789050115.217650:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120960 00002000:00100000:1.0:1789050115.217703:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ba983c89500 x1875954704120960/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:616/0 lens 504/0 e 0 to 0 dl 1789050126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789050115.217716:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983c89500 with x1875954704120960 ext(0->12) 00002000:00010000:1.0:1789050115.217729:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983c89500 00000100:00100000:1.0:1789050115.217758:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789050115.217769:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+10:2403:x1875954704120960:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789050115.221931:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+12:2403:x1875954704120960:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 4147us (4431us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789050115.222006:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00002000:00100000:1.0:1789050115.222020:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ba983c89500 x1875954704120960/t4294967309(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:616/0 lens 504/448 e 0 to 0 dl 1789050126 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789050115.222030:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983c89500 with x1875954704120960 ext(0->12) 00002000:00010000:1.0:1789050115.222037:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983c89500 00000100:00100000:0.0:1789050115.234927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.239103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121088 00000100:00100000:3.0:1789050115.239118:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121088 00000100:00100000:2.0:1789050115.239616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:2.0:1789050115.239628:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+71:11419:x1875954704121088:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1789050115.241124:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789050115.251827:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1789050115.251924:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000004:00080000:2.0:1789050115.251935:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789050115.252013:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789050115.252167:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714671488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789050115.252253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050115.252311:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050115.252317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714671360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050115.252338:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050115.252363:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714671488 00000100:00100000:0.0:1789050115.252370:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714671488 00000100:00100000:0.0:1789050115.252410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714671360 00000100:00100000:0.0:1789050115.252412:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714671360 00000100:00100000:0.0:1789050115.252441:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050115.252448:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875954714671488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789050115.252576:0:8434:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789050115.252580:0:8434:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789050114291050397 00002000:00010000:0.0:1789050115.252583:0:8434:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789050115.252585:0:8434:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789050114202000000 -> 1789050114291050397 00002000:00010000:0.0:1789050115.252587:0:8434:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789050115.252621:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1875954714671488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (368us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789050115.252627:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050115.252658:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050115.252663:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875954714671360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789050115.252678:0:8434:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1789050115.252695:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.252716:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.252725:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789050115.252729:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050115.252734:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.252760:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.252773:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 11 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.252784:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714671616:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050115.252855:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2840 going to sleep for 11 seconds 00000004:00080000:0.0:1789050115.252887:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba98369c380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789050115.252893:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714671488:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789050115.253862:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253874:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253881:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253887:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.253891:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253899:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253971:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8baa83dbb500) 00010000:00010000:3.0:1789050115.253975:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.253980:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.253987:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df579f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254016:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254023:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254028:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254033:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.254036:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254041:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254048:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8baa83dbbe00) 00010000:00010000:3.0:1789050115.254050:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.254053:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254058:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778000/0x3b8ec5973df57a98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254084:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254091:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254097:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254102:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.254105:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254110:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254117:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:3.0:1789050115.254119:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.254122:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254127:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57b16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254137:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254142:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254147:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254158:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.254162:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254168:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254176:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ba9832fdb00) 00010000:00010000:3.0:1789050115.254179:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.254181:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254188:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57b39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254203:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254219:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254225:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254230:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.254233:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254239:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254258:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050115.254261:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050115.254264:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254270:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57c0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254283:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254289:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254294:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254299:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050115.254301:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254307:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254314:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:3.0:1789050115.254316:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789050115.254318:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.254323:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57cc8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789050115.254352:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050115.254882:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050115.254899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714671744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789050115.255005:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.255122:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714671744 00000100:00100000:1.0:1789050115.255130:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714671744 00000100:00100000:1.0:1789050115.255171:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789050115.255180:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1875954714671744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789050115.255202:0:8432:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789050115.255237:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb994b1d8188, atime: 0x18d3fb9958668bbf, ctime: 0x18d3fb994b1d8188, blocks: 0x8 00010000:00010000:1.0:1789050115.255244:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.255259:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1789050115.255263:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050115.255269:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.255284:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.255293:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.255313:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.255330:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789050115.255639:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3647:x1875954714671744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 460us (633us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789050115.255646:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789050115.256177:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050115.256185:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.256195:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050115.256200:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.256547:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.256567:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.256575:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fae61f6/0x3b8ec5973df57cf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.256595:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050115.256597:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050115.256599:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050115.256886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.256909:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121216 00000100:00100000:0.0:1789050115.256916:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121216 00010000:00010000:0.0:1789050115.257734:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 12 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.257773:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:0.0:1789050115.257783:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+12:2403:x1875954704121216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050115.257797:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050115.257802:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 12 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.257813:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 12 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.257833:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050115.257837:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050115.257842:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.257851:0:6505:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.257870:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1789050115.257904:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baaac5e9c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789050115.257909:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98352d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baab0fcda80 00000020:00080000:2.0:1789050115.257913:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98352d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba983535200 00000100:00100000:0.0:1789050115.257916:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+12:2403:x1875954704121216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 136us (1032us total) trans 0 rc 0/0 00000020:00080000:2.0:1789050115.257997:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baa85eb1600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789050115.258001:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98243f600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baa85eb1240 00000020:00080000:2.0:1789050115.258004:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98243fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba9825cba00 00000020:00080000:2.0:1789050115.258015:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789050115.258140:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:3.0:1789050115.258179:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df57aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b94 expref: 12 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050115.258196:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714671616:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050115.258226:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.258246:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.258253:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.258262:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789050115.258266:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1789050115.258271:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050115.258287:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789050115.258345:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+16:11419:x1875954704121088:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 18720us (23430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.258353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:3.0:1789050115.258416:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1875954714671360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5752us (6076us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789050115.258423:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1789050115.258438:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba98369fb80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789050115.258444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714671360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050115.258632:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00010000:00010000:1.0:1789050115.258678:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050115.258685:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050115.259143:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983c11500/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789050115.259150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714671744:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789050115.260200:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050115.260277:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.260291:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.260311:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.260319:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df57cf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.260340:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050115.260357:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050115.260360:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789050115.261340:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789050115.261354:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789050115.270435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050115.270534:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121344 00000100:00100000:3.0:1789050115.270544:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121344 00000100:00100000:3.0:1789050115.270661:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:3.0:1789050115.270672:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+11:2404:x1875954704121344:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789050115.272689:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789050115.272705:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789050115.273199:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704121344:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 2524us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.273210:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789050115.276616:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.276770:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121600 00000100:00100000:2.0:1789050115.276781:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121600 00000100:00100000:2.0:1789050115.276902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:2.0:1789050115.276914:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:11419:x1875954704121600:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050115.277051:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050115.277095:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df57cdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c2e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.277111:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:2.0:1789050115.277115:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050115.277139:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.277151:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.277160:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050115.277281:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000009332d6dc reply state 000000007b06a48d transno 4294967407 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.277293:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.277299:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:2.0:1789050115.277302:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050115.277304:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050115.277416:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+17:11419:x1875954704121600:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 504us (808us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1789050115.277424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:0.0:1789050115.281137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.281357:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121728 00000100:00100000:1.0:1789050115.281366:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121728 00000100:00100000:1.0:1789050115.281419:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789050115.281430:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704121728:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789050115.281586:0:8433:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789050115.281590:0:8433:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789050114291050397 -> 1789050113440000000 00002000:00010000:1.0:1789050115.281592:0:8433:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789050113027000000 00002000:00010000:1.0:1789050115.281595:0:8433:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789050114291050397 -> 1789050113440000000 00002000:00010000:1.0:1789050115.281597:0:8433:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789050115.281665:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704121728:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 236us (537us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789050115.281670:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789050115.284721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.284810:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121984 00000100:00100000:0.0:1789050115.284820:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121984 00000100:00100000:0.0:1789050115.284900:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00100000:0.0:1789050115.284908:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+17:11419:x1875954704121984:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789050115.285010:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.285034:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 17 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.285045:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.285079:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 17 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.285092:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 17 pid: 14070 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.285123:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714671872:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050115.285210:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050115.288124:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.288593:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122112 00000100:00100000:1.0:1789050115.288604:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122112 00010000:00010000:1.0:1789050115.288642:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 18 pid: 14070 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.288683:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:1.0:1789050115.288693:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2404:x1875954704122112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050115.288707:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050115.288713:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 18 pid: 14070 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.288726:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 18 pid: 14070 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.288763:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:1.0:1789050115.288768:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.288780:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.288788:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.288807:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050115.288861:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2404:x1875954704122112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 168us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.288868:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00010000:00010000:3.0:1789050115.289069:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df57cc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c20 expref: 17 pid: 14070 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050115.289101:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714671872:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050115.289122:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289831:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289842:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289882:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289890:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289897:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289903:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050115.289917:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.289924:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.290138:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:1.0:1789050115.290142:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789050115.290261:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.290269:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df57d07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.290366:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+16:11419:x1875954704121984:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 5457us (5652us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789050115.290375:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00100000:0.0:1789050115.292197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.292296:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122240 00000100:00100000:1.0:1789050115.292306:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122240 00000100:00100000:1.0:1789050115.292353:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:1.0:1789050115.292363:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704122240:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789050115.292499:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.292520:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.292529:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050115.292534:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050115.292546:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.292584:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.292599:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 7 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.292615:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714672000:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050115.292695:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050115.294666:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714672000:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050115.294695:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.295791:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.295864:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122368 00000100:00100000:1.0:1789050115.295872:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122368 00010000:00010000:1.0:1789050115.295913:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 8 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.295983:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:1.0:1789050115.295993:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704122368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050115.296007:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050115.296028:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 8 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.296065:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 8 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.296100:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6633aef/0x3b8ec5973df57ceb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c3c expref: 8 pid: 8432 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.296119:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050115.296123:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050115.296129:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.296138:0:7460:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.296339:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050115.296390:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704122368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 398us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.296398:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 75 00010000:00010000:2.0:1789050115.296518:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296527:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296562:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296571:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296579:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296585:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050115.296590:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296598:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296611:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.296619:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df57d0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.296664:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704122240:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 4302us (4474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.296671:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:0.0:1789050115.303483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.303559:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122624 00000100:00100000:1.0:1789050115.303570:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122624 00000100:00100000:1.0:1789050115.303629:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:1.0:1789050115.303639:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+16:11419:x1875954704122624:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789050115.303714:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.303730:0:14070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.303756:0:14070:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.303793:0:14070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.303807:0:14070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 16 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.303822:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672128:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050115.303904:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050115.307772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.307886:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672128:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050115.307919:0:14070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.308052:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122752 00000100:00100000:0.0:1789050115.308060:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122752 00010000:00010000:0.0:1789050115.308110:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 17 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.308149:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:0.0:1789050115.308159:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+17:2404:x1875954704122752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050115.308173:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050115.308180:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 17 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308193:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 17 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308216:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae778600/0x3b8ec5973df57c04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966be8 expref: 17 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308231:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050115.308236:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 16 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308262:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308271:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308279:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.308312:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050115.308369:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+16:2404:x1875954704122752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 210us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.308377:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00010000:00010000:2.0:1789050115.308511:0:14070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308519:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308698:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308710:0:14070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 16 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308718:0:14070:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308764:0:14070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 16 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.308778:0:14070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 16 pid: 13807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.308792:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672256:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050115.308857:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050115.313776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.313883:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672256:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050115.313916:0:14070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.314180:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122880 00000100:00100000:0.0:1789050115.314188:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122880 00010000:00010000:0.0:1789050115.314225:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 17 pid: 13807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.314303:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:0.0:1789050115.314313:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+17:2404:x1875954704122880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050115.314328:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050115.314335:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 17 pid: 13807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314348:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 17 pid: 13807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314391:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df57ccf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c27 expref: 17 pid: 13807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314408:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:0.0:1789050115.314412:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314422:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314430:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.314457:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050115.314514:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:2404:x1875954704122880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 202us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.314522:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00010000:00010000:2.0:1789050115.314575:0:14070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.314595:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050115.314706:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000001:00080000:2.0:1789050115.314818:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00000001:00080000:2.0:1789050115.314855:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00000100:00100000:2.0:1789050115.314926:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14070:1875954714672384:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1789050115.315014:0:14070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.315049:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa01b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050115.315123:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714672384 00000100:00100000:3.0:1789050115.315128:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714672384 00000100:00100000:3.0:1789050115.315167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789050115.315175:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14070:x1875954714672384:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1789050115.315252:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14070:x1875954714672384:12345-0@lo:1000:mdt00_005.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.315259:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789050115.315691:0:14070:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789050115.315697:0:14070:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1789050115.315715:0:14070:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba98369c380, transno 4294967310 00000004:00080000:2.0:1789050115.315729:0:14070:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba98369fb80, transno 4294967311 00000100:00100000:2.0:1789050115.315737:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14070:1875954714672384:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1789050115.315844:0:14070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967411 00000100:00100000:2.0:1789050115.315888:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14070:1875954714672512:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1789050115.315919:0:14070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.315973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714672512 00000100:00100000:2.0:1789050115.315978:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714672512 00000100:00100000:2.0:1789050115.316005:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789050115.316011:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14070:x1875954714672512:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1789050115.316220:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14070:x1875954714672512:12345-0@lo:1000:mdt00_005.0 Request processed in 208us (300us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789050115.316227:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789050115.316245:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac6a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050115.316262:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d95880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14070:1875954714672512:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1789050115.316304:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316312:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316320:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316327:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050115.316331:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316339:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316352:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:2.0:1789050115.316356:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050115.316360:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316366:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d1c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316388:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316395:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316400:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316414:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050115.316417:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316424:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316433:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050115.316436:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050115.316442:0:14070:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316454:0:14070:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316463:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.316486:0:14070:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 19 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.316497:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672640:192.168.203.42@tcp:105: 00000100:00100000:2.0:1789050115.316549:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82458a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050115.318365:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714672640:192.168.203.42@tcp:105: 00010000:00010000:2.0:1789050115.318391:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318416:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df57c5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318446:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318458:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318468:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318477:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318482:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318488:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318493:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050115.318497:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318502:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318512:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050115.318515:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050115.318518:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318530:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318542:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318548:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318553:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318558:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050115.318561:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318566:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318574:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050115.318576:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050115.318579:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.318585:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57d15 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.318745:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+19:11419:x1875954704122624:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 15107us (15270us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789050115.318756:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 139 00000020:00080000:2.0:1789050115.318767:0:14070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789050115.318893:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050115.318899:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050115.319561:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789050115.319571:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050115.320229:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.320728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123008 00000100:00100000:2.0:1789050115.320739:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123008 00000100:00100000:2.0:1789050115.320823:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:2.0:1789050115.320833:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:11418:x1875954704123008:12345-192.168.203.42@tcp:49:lfs.0 00000100:00100000:2.0:1789050115.321006:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:11418:x1875954704123008:12345-192.168.203.42@tcp:49:lfs.0 Request processed in 173us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.321013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:1.0:1789050115.322737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.322811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123264 00000100:00100000:0.0:1789050115.322819:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123264 00000100:00100000:0.0:1789050115.322869:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:0.0:1789050115.322879:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:11419:x1875954704123264:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050115.323217:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789050115.323249:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967413 00010000:00010000:0.0:1789050115.323300:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323317:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323337:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323343:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323349:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.323470:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050115.323594:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:11419:x1875954704123264:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 715us (861us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789050115.323602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000020:00080000:0.0:1789050115.323607:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050115.324667:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050115.324678:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.324687:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050115.324692:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.324701:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.324715:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:1.0:1789050115.324731:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050115.324737:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.324743:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df57d2a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.324758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050115.324760:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050115.324762:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050115.328342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050115.329491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123520 00000100:00100000:1.0:1789050115.329503:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123520 00000100:00100000:1.0:1789050115.329612:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:1.0:1789050115.329623:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:11418:x1875954704123520:12345-192.168.203.42@tcp:58:lfs.0 00000040:00080000:1.0:1789050115.329797:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789050115.329884:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:11418:x1875954704123520:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 262us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.329892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:0.0:1789050115.373173:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.373289:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123648 00000100:00100000:2.0:1789050115.373299:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123648 00000100:00100000:2.0:1789050115.373399:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:2.0:1789050115.373409:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+21:11421:x1875954704123648:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050115.373433:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050115.373454:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c43 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373524:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373539:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373551:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373565:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373573:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373599:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373673:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373684:0:13807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373693:0:13807:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373731:0:13807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050115.373746:0:13807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 22 pid: 6519 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050115.373761:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714672768:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050115.373859:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82458a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050115.377314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050115.377438:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13807:1875954714672768:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050115.377469:0:13807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050115.377629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123904 00000100:00100000:1.0:1789050115.377636:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123904 00000100:00100000:1.0:1789050115.377693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:1.0:1789050115.377702:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:6174:x1875954704123904:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789050115.377929:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+24:6174:x1875954704123904:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 226us (623us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789050115.377974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:3.0:1789050115.381203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050115.381312:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124032 00000100:00100000:0.0:1789050115.381321:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124032 00010000:00010000:0.0:1789050115.381364:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 24 pid: 6519 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050115.381419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:0.0:1789050115.381430:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+24:2403:x1875954704124032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050115.381463:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050115.381470:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 24 pid: 6519 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381483:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 24 pid: 6519 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381506:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57c51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c04 expref: 24 pid: 6519 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381524:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:0.0:1789050115.381529:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381539:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381546:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050115.381582:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050115.381640:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+23:2403:x1875954704124032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 210us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050115.381647:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00010000:00010000:1.0:1789050115.382441:0:13807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382453:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050115.382519:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789050115.382523:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050115.382545:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382559:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382570:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382577:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382583:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382590:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050115.382594:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382603:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382614:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:1.0:1789050115.382617:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050115.382620:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382627:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57d38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382651:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382656:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382661:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382666:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050115.382668:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382674:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382682:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8baaae575300) 00010000:00010000:1.0:1789050115.382684:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050115.382687:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382693:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57d3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382730:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57d31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c43 expref: 23 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382744:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c43 expref: 22 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050115.382764:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:1.0:1789050115.382767:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050115.382769:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695200, rc 0) 00000100:00100000:1.0:1789050115.382817:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+22:11421:x1875954704123648:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9408us (9654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.382825:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:2.0:1789050115.689688:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050115.689716:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab77d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714672896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050115.689788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050115.690193:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714672896 00000100:00100000:3.0:1789050115.690201:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714672896 00000100:00080000:2.0:1789050115.690350:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050115.690400:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789050115.690410:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714672896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050115.690434:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789050115.690538:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714672896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050115.690546:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789050115.690635:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050115.690646:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714673024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050115.690679:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.690708:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673024 00000100:00100000:1.0:1789050115.690712:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673024 00000100:00100000:1.0:1789050115.690735:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789050115.690741:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714673024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050115.690751:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1789050115.690779:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714673024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.690784:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789050115.690824:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714673024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050115.691583:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab77d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714672896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050115.693109:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714673280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693171:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.693207:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714673792:0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693230:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.693256:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789050115.693262:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714673408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693288:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.693304:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714673920:0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050115.693370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673280 00000100:00100000:2.0:1789050115.693376:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673280 00000100:00100000:2.0:1789050115.693414:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673792 00000100:00100000:2.0:1789050115.693417:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673792 00000100:00100000:2.0:1789050115.693441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673920 00000100:00100000:2.0:1789050115.693444:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673920 00000100:00100000:2.0:1789050115.693476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789050115.693483:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714673280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693527:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714673280:12345-0@lo:400:kworker.0 Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050115.693534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789050115.693549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789050115.693556:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714673792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.693582:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714673792:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.693695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789050115.693705:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714673920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.693739:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714673920:12345-0@lo:400:kworker.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.693745:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789050115.693774:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714673152:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.693819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.693844:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714673664:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.693867:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.693884:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714674176:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.693906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.693923:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789050115.693928:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714673536:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694023:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.694041:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714674048:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050115.694085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673152 00000100:00100000:1.0:1789050115.694089:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673152 00000100:00100000:1.0:1789050115.694119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789050115.694125:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714673152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694158:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714673152:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694164:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789050115.694192:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673408 00000100:00100000:1.0:1789050115.694196:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673408 00000100:00100000:1.0:1789050115.694219:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673664 00000100:00100000:1.0:1789050115.694222:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673664 00000100:00100000:1.0:1789050115.694236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789050115.694242:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714673408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694273:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714673408:12345-0@lo:400:kworker.0 Request processed in 31us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694278:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789050115.694298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789050115.694303:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714673664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694332:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714673664:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694338:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789050115.694361:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674176 00000100:00100000:1.0:1789050115.694364:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674176 00000100:00100000:1.0:1789050115.694381:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714673536 00000100:00100000:1.0:1789050115.694383:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714673536 00000100:00100000:1.0:1789050115.694391:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674048 00000100:00100000:1.0:1789050115.694393:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674048 00000100:00100000:1.0:1789050115.694405:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789050115.694411:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714674176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694442:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714674176:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694448:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789050115.694459:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789050115.694464:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714673536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694488:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714673536:12345-0@lo:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694493:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789050115.694503:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789050115.694509:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714674048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694533:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714674048:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050115.694538:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789050115.694578:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714673536:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694676:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714674048:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694684:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714673152:0@lo:400:kworker.0 00000100:00100000:1.0:1789050115.694692:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714673664:0@lo:400:kworker.0 00010000:00080000:1.0:1789050115.694706:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d96d80 x1875954714674176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050115.694716:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714674176:0@lo:400:kworker.0 00000100:00080000:3.0:1789050115.694804:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050115.694814:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050115.695431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714673408:0@lo:400:kworker.0 00010000:00080000:3.0:1789050115.695445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d94380 x1875954714673920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050115.695454:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714673920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050115.695465:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714673280:0@lo:400:kworker.0 00000100:00100000:3.0:1789050115.695474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714673792:0@lo:400:kworker.0 00000100:00100000:2.0:1789050115.696840:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000040:00080000:3.0:1789050116.055645:0:14258:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050116.055655:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050116.055689:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789050116.055697:0:14258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789050116.265289:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050116.332241:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050116.332250:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050116.332280:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789050116.332289:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050116.332431:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714674304:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050116.332572:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050116.338510:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714674304:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050116.346192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050116.346559:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124160 00000100:00100000:1.0:1789050116.346570:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124160 00000100:00100000:1.0:1789050116.346640:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:1.0:1789050116.346650:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+22:11433:x1875954704124160:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050116.346873:0:13807:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050116.347298:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+22:11433:x1875954704124160:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 648us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050116.347307:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789050116.351357:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050116.351862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124416 00000100:00100000:1.0:1789050116.351873:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124416 00000100:00100000:1.0:1789050116.351975:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:1.0:1789050116.351987:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+22:11433:x1875954704124416:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050116.352007:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050116.352026:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df57d4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.352153:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df57d54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.352193:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df57d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.352207:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df57d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050116.352220:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789050116.352328:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df57d4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c4a expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.352346:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df57d54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c4a expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.352354:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:1.0:1789050116.352357:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050116.352360:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570c00, rc 0) 00000100:00100000:1.0:1789050116.352427:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+24:11433:x1875954704124416:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 443us (1078us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789050116.352434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:3.0:1789050116.358558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050116.358608:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.358703:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124800 00000100:00100000:2.0:1789050116.358716:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124800 00000100:00100000:2.0:1789050116.358793:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:2.0:1789050116.358806:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+24:11433:x1875954704124800:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050116.358885:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.358902:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.358914:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359161:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359169:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359175:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359181:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050116.359185:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359192:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359203:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050116.359221:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050116.359226:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050116.359232:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57d62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050116.359349:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba982712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+25:11433:x1875954704124800:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 546us (738us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789050116.359357:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 144 00000040:00080000:0.0:1789050116.359585:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050116.359590:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050116.360039:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789050116.360047:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050116.360784:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124544 00000100:00100000:1.0:1789050116.360794:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124544 00000100:00100000:1.0:1789050116.360865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789050116.360877:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+25:2404:x1875954704124544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050116.360893:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050116.360914:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df57d54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c4a expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050116.360988:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:1.0:1789050116.360993:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050116.361043:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+24:2404:x1875954704124544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 168us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050116.361051:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789050116.371457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050116.371575:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125056 00000100:00100000:1.0:1789050116.371587:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125056 00000100:00100000:1.0:1789050116.371652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:1.0:1789050116.371662:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+24:11433:x1875954704125056:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789050116.371900:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+25:11433:x1875954704125056:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 239us (452us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789050116.371908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789050116.553660:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553701:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553796:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050116.553849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125696 00000100:00100000:2.0:1789050116.553858:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125696 00000100:00100000:2.0:1789050116.553915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125312 00000100:00100000:2.0:1789050116.553918:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125312 00000100:00100000:2.0:1789050116.553980:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125824 00000100:00100000:2.0:1789050116.553983:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125824 00000100:00100000:2.0:1789050116.554011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 288 00000100:00100000:2.0:1789050116.554020:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704125696:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050116.554092:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704125696:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050116.554100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 288 00000100:00100000:2.0:1789050116.554117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 289 00000100:00100000:2.0:1789050116.554123:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704125312:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050116.554167:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704125312:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 44us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050116.554173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 289 00000100:00100000:2.0:1789050116.554185:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00100000:2.0:1789050116.554191:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704125824:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050116.554212:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704125824:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 22us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050116.554217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00080000:2.0:1789050116.554262:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050116.554266:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050116.554442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125184 00000100:00100000:3.0:1789050116.554448:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125184 00000100:00100000:0.0:1789050116.554743:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125440 00000100:00100000:0.0:1789050116.554748:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125440 00000100:00100000:0.0:1789050116.554793:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125568 00000100:00100000:0.0:1789050116.554796:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125568 00000100:00100000:0.0:1789050116.554818:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:0.0:1789050116.554825:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704125440:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050116.554861:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704125440:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050116.554867:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:0.0:1789050116.554881:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:0.0:1789050116.554887:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704125568:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050116.554910:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704125568:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050116.554915:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:2.0:1789050116.555345:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 378 00000100:00100000:2.0:1789050116.555353:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704125184:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050116.555384:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab9344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704125184:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 32us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050116.555391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 378 00000100:00080000:2.0:1789050116.555426:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789050117.289380:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050117.871455:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050117.871464:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050117.871497:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789050117.871504:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050118.104271:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050118.104363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126080 00000100:00100000:3.0:1789050118.104373:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126080 00000100:00100000:3.0:1789050118.104453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00100000:3.0:1789050118.104465:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+25:11454:x1875954704126080:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050118.104490:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050118.104511:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57d69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.104641:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57d70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.104658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57d70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.104671:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57d70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050118.104683:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789050118.104791:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df57d69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c51 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.104812:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57d70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c51 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.104821:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050118.104825:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050118.104829:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:3.0:1789050118.104908:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+27:11454:x1875954704126080:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 445us (645us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789050118.104916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00080000:2.0:1789050118.105015:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050118.109723:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050118.109935:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126208 00000100:00100000:2.0:1789050118.109978:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126208 00000100:00100000:2.0:1789050118.110087:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:2.0:1789050118.110108:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+27:11454:x1875954704126208:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050118.110186:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110207:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110227:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110266:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110274:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110280:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110285:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050118.110289:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110296:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110307:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:2.0:1789050118.110311:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050118.110317:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.110323:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57d7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050118.110401:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+27:11454:x1875954704126208:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 303us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050118.110408:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:0.0:1789050118.233305:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050118.233404:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126336 00000100:00100000:3.0:1789050118.233414:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126336 00000100:00100000:3.0:1789050118.233504:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:3.0:1789050118.233516:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704126336:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789050118.233538:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050118.233575:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf50f33a/0x3b8ec5973df57d85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c58 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050118.233603:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb9970f6a800, atime: 0x18d3fb995858c6c0, ctime: 0x18d3fb9970f6a800, blocks: 0x8 00010000:00010000:3.0:1789050118.233624:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1789050118.233629:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050118.233639:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf50f33a/0x3b8ec5973df57d85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c58 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.233658:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf50f33a/0x3b8ec5973df57d85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c58 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050118.233670:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176800, rc 0) 00000100:00100000:3.0:1789050118.233737:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704126336:12345-192.168.203.42@tcp:101:cat.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050118.233744:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00080000:2.0:1789050118.233862:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050118.240438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050118.243453:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126464 00000100:00100000:0.0:1789050118.243466:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126464 00002000:00100000:2.0:1789050118.243777:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ba983d94000 x1875954704126464/t0(0) o3->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:619/0 lens 488/0 e 0 to 0 dl 1789050129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050118.243786:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983d94000 with x1875954704126464 ext(0->4095) 00002000:00010000:2.0:1789050118.243791:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983d94000 00000100:00100000:0.0:1789050118.243857:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789050118.243869:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2406:x1875954704126464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1789050118.244612:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2406:x1875954704126464:12345-192.168.203.42@tcp:3:cat.0 Request processed in 739us (4178us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789050118.244620:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00002000:00100000:0.0:1789050118.244627:0:8439:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ba983d94000 x1875954704126464/t0(0) o3->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:619/0 lens 488/4536 e 0 to 0 dl 1789050129 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050118.244636:0:8439:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983d94000 with x1875954704126464 ext(0->4095) 00002000:00010000:0.0:1789050118.244640:0:8439:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983d94000 00000100:00100000:3.0:1789050118.249120:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714674432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050118.249334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050118.249846:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674432 00000100:00100000:1.0:1789050118.249855:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674432 00000100:00100000:1.0:1789050118.249908:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789050118.249918:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714674432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050118.249981:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789050118.254150:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714674432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4076us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050118.254160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714674432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050118.254165:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00010000:1.0:1789050118.313128:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050118.761548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714674560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050118.761636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050118.762052:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674560 00000100:00100000:0.0:1789050118.762062:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674560 00000100:00100000:0.0:1789050118.762123:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789050118.762133:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714674560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050118.762169:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050118.762227:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714674560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050118.762234:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789050118.762330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714674560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050119.341099:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050120.298680:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714674688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050120.298771:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.298884:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674688 00000100:00100000:0.0:1789050120.298895:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674688 00000100:00100000:0.0:1789050120.298997:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789050120.299011:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714674688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050120.299083:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050120.299138:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714674688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.299145:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789050120.299191:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789050120.299198:0:3644:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1789050120.299223:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba9832c3b80, transno 4294967302 00000004:00080000:0.0:1789050120.299233:0:3644:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1789050120.299246:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983c11500, transno 4294967305 00000100:00100000:0.0:1789050120.299272:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714674688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050120.303009:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714674816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050120.303122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.303227:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674816 00000100:00100000:0.0:1789050120.303237:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674816 00000100:00100000:0.0:1789050120.303317:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789050120.303607:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714674816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050120.303637:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050120.303693:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714674816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.303700:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789050120.303759:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714674816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789050120.304519:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789050120.307424:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00010000:00010000:2.0:1789050120.307468:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789050120.307472:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baaac6a06c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789050120.307477:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba982436700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baa8874a3c0 00010000:00010000:2.0:1789050120.307481:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050120.307490:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050120.307497:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050120.307503:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050120.307511:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789050120.307554:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba982436b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba9834a0000 00000020:00080000:3.0:1789050120.307619:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1789050120.307834:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789050120.307878:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1789050120.307932:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8baa9294f700) 00010000:00010000:2.0:1789050120.308114:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050120.308119:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050120.308124:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57d00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050120.361301:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050120.809391:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714674944:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809515:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714675456:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809726:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714675968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809752:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809771:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714676480:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809812:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789050120.809818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714675072:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714675584:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809895:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.809922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714676096:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.809976:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050120.810004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050120.810030:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050120.810069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675968 00000100:00100000:3.0:1789050120.810070:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676480 00000100:00100000:0.0:1789050120.810076:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714675200:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.810079:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676480 00000100:00100000:2.0:1789050120.810079:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675968 00000100:00100000:0.0:1789050120.810190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810213:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714675712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.810235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810253:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714676224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.810277:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714676608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050120.810317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810337:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789050120.810344:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714675328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.810364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810382:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714675840:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.810402:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050120.810416:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714676352:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.810439:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050120.810875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675840 00000100:00100000:2.0:1789050120.810881:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675840 00000100:00100000:2.0:1789050120.810903:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676352 00000100:00100000:2.0:1789050120.810906:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676352 00000100:00100000:2.0:1789050120.810935:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789050120.810967:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875954714676480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.811721:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789050120.811735:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714675968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.814547:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714675968:12345-0@lo:400:kworker.0 Request processed in 2806us (4784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050120.814562:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789050120.814609:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789050120.814622:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050120.816180:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875954714676480:12345-0@lo:400:kworker.0 Request processed in 5207us (6380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050120.816194:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789050120.816232:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789050120.816248:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714676352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050120.817271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675072 00000100:00100000:1.0:1789050120.817280:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675072 00000100:00100000:1.0:1789050120.817312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675584 00000100:00100000:1.0:1789050120.817314:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675584 00000100:00100000:1.0:1789050120.817326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676096 00000100:00100000:1.0:1789050120.817328:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676096 00000100:00100000:1.0:1789050120.817338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675712 00000100:00100000:1.0:1789050120.817339:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675712 00000100:00100000:1.0:1789050120.817348:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789050120.817355:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714675072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.817367:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676224 00000100:00100000:0.0:1789050120.817374:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676224 00000100:00100000:0.0:1789050120.817408:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675328 00000100:00100000:1.0:1789050120.817413:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714675072:12345-0@lo:400:kworker.0 Request processed in 57us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.817413:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675328 00000100:00100000:1.0:1789050120.817423:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789050120.817435:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789050120.817444:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714675584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050120.817447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789050120.817459:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050120.817488:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714676096:12345-0@lo:400:kworker.0 Request processed in 32us (7513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050120.817493:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789050120.817503:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789050120.817509:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714675712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.818453:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714675584:12345-0@lo:400:kworker.0 Request processed in 1005us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.818515:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789050120.820439:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789050120.820444:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714675712:12345-0@lo:400:kworker.0 Request processed in 2930us (10202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050120.820454:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789050120.820463:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714676224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050120.820481:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789050120.820490:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714675328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.820558:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714676224:12345-0@lo:400:kworker.0 Request processed in 108us (10280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.820565:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789050120.820595:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676736 00000100:00100000:0.0:1789050120.820602:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676736 00000100:00100000:0.0:1789050120.820635:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676608 00000100:00100000:0.0:1789050120.820638:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676608 00000100:00100000:0.0:1789050120.820654:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789050120.820659:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714676736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050120.820680:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789050120.820720:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714676736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (10690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.820725:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789050120.820739:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789050120.820745:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714676608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050120.820755:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789050120.820780:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714676608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (10463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050120.820786:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789050120.820839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714675328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.821054:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714675840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821059:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714675840:12345-0@lo:400:kworker.0 Request processed in 6438us (10651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050120.821091:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789050120.821133:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050120.821138:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050120.821141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050120.821172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050120.821237:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714674944 00000100:00100000:3.0:1789050120.821242:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714674944 00000100:00100000:3.0:1789050120.821271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789050120.821279:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821314:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3646:x1875954714674944:12345-0@lo:400:kworker.0 Request processed in 36us (11843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050120.821320:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789050120.821351:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675456 00000100:00100000:3.0:1789050120.821355:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675456 00000100:00100000:3.0:1789050120.821376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714675200 00000100:00100000:3.0:1789050120.821379:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714675200 00000100:00100000:3.0:1789050120.821391:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789050120.821397:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714675456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821427:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714675456:12345-0@lo:400:kworker.0 Request processed in 30us (11862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050120.821433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789050120.821445:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789050120.821450:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714675200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821546:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714675200:12345-0@lo:400:kworker.0 Request processed in 96us (11356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050120.821553:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789050120.821659:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714675072:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821681:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714675584:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821693:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714676096:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714674944:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821711:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714675456:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821721:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714675968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050120.821730:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714676480:0@lo:400:kworker.0 00000100:00100000:2.0:1789050120.827707:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714676352:12345-0@lo:400:kworker.0 Request processed in 11456us (17255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050120.827723:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050120.828005:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714675328:12345-0@lo:400:kworker.0 Request processed in 7514us (17636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050120.828035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789050120.828806:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714676352:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.828833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714675200:0@lo:400:kworker.0 00010000:00080000:0.0:1789050120.828860:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d9a680 x1875954714675712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050120.828871:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714675712:0@lo:400:kworker.0 00010000:00080000:0.0:1789050120.828883:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d9bb80 x1875954714676224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050120.828892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714676224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050120.828918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714676608:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789050120.836026:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1789050120.836357:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1789050121.390225:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050121.674060:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050121.674226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050121.674267:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127104 00000100:00100000:2.0:1789050121.674277:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127104 00000100:00100000:2.0:1789050121.674343:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126976 00000100:00100000:2.0:1789050121.674347:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126976 00000100:00100000:2.0:1789050121.674375:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:3.0:1789050121.674378:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126592 00000100:00100000:3.0:1789050121.674382:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126592 00000100:00100000:2.0:1789050121.674385:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704127104:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050121.674408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 380 00000100:00100000:3.0:1789050121.674415:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704126592:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050121.674458:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704127104:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050121.674476:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:2.0:1789050121.674493:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:2.0:1789050121.674516:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704126976:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050121.674976:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126848 00000100:00100000:0.0:1789050121.674982:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126848 00000100:00100000:0.0:1789050121.675016:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127360 00000100:00100000:0.0:1789050121.675019:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127360 00000100:00100000:0.0:1789050121.675037:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126720 00000100:00100000:0.0:1789050121.675040:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126720 00000100:00100000:0.0:1789050121.675053:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127232 00000100:00100000:0.0:1789050121.675055:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127232 00000100:00100000:0.0:1789050121.675071:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 297 00000100:00100000:0.0:1789050121.675078:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704126848:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:1.0:1789050121.675271:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050121.675277:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789050121.675279:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050121.675281:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050121.675296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 298 00000100:00100000:3.0:1789050121.675304:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704126592:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 888us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050121.675304:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704127360:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050121.675313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 380 00000100:00100000:1.0:1789050121.675332:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704127360:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050121.675337:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 298 00000100:00100000:1.0:1789050121.675351:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 299 00000100:00100000:3.0:1789050121.675357:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 300 00000100:00100000:1.0:1789050121.675358:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2405:x1875954704126720:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050121.675363:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704127232:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050121.675380:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2405:x1875954704126720:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050121.675383:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704127232:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 20us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050121.675386:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 299 00000100:00100000:3.0:1789050121.675389:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 300 00000100:00100000:2.0:1789050121.675973:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704126976:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1454us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050121.675982:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789050121.678177:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704126848:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 3087us (4066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050121.678192:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 297 00010000:00010000:1.0:1789050122.415224:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050122.541621:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050122.541631:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050122.541652:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789050122.541671:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789050122.857494:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789050123.021840:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050123.021961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127488 00000100:00100000:1.0:1789050123.021972:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127488 00000100:00100000:1.0:1789050123.022093:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00100000:1.0:1789050123.022105:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:11106:x1875954704127488:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789050123.022230:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:11106:x1875954704127488:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 128us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050123.022237:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00080000:3.0:1789050123.027551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050123.030356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050123.031269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127616 00000100:00100000:3.0:1789050123.031288:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127616 00000100:00100000:3.0:1789050123.031413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00100000:3.0:1789050123.031430:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:11106:x1875954704127616:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789050123.031577:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:11106:x1875954704127616:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 154us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050123.031585:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00080000:1.0:1789050123.032285:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050123.033736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050123.034213:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127872 00000100:00100000:3.0:1789050123.034228:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127872 00000100:00100000:3.0:1789050123.034532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:3.0:1789050123.034544:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:11106:x1875954704127872:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050123.034921:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+14:11106:x1875954704127872:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 377us (1301us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789050123.034966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789050123.369727:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714676864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050123.369837:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050123.371121:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676864 00000100:00100000:3.0:1789050123.371138:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676864 00000100:00100000:3.0:1789050123.371231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789050123.371244:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714676864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050123.371296:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789050123.371399:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714676864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050123.371407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789050123.371542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714676864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050123.434621:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050123.881766:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714676992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050123.881840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050123.882377:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714676992 00000100:00100000:0.0:1789050123.882394:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714676992 00000100:00100000:0.0:1789050123.882470:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789050123.882481:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714676992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050123.882517:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050123.882565:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714676992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050123.882571:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789050123.882700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714676992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050124.457112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050124.664164:0:14507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:22:02 (1789050122) 00000100:00100000:0.0:1789050125.417145:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050125.417146:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050125.417173:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714677248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050125.417173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714677120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050125.417324:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050125.417366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.417418:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677248 00000100:00100000:3.0:1789050125.417426:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677248 00000100:00100000:3.0:1789050125.417486:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677120 00000100:00100000:3.0:1789050125.417490:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677120 00000100:00100000:3.0:1789050125.417513:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789050125.417523:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714677248:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050125.417547:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00002000:00000024:3.0:1789050125.417554:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050125.417561:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714677120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050125.417576:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050125.417607:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714677248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.417616:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789050125.417626:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714677120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.417635:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789050125.417670:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714677248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050125.417683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714677120:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789050125.417760:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789050125.481155:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050125.904600:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050125.904722:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128128 00000100:00100000:3.0:1789050125.904733:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128128 00000100:00100000:3.0:1789050125.904860:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:3.0:1789050125.904872:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+14:12175:x1875954704128128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050125.904909:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050125.904929:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57d8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c5f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905040:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905056:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905088:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905144:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905153:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905173:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905264:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57da1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905273:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57da1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905280:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57da1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050125.905291:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789050125.905382:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905390:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905396:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905402:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050125.905412:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905420:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905433:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baab0f94200) 00010000:00010000:3.0:1789050125.905436:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050125.905441:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905448:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57d93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905463:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905469:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905475:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905480:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050125.905483:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905488:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905496:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050125.905498:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050125.905507:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.905513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57d9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789050125.905695:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050125.906423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57d8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c5f expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.906442:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57da1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c5f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.906451:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:3.0:1789050125.906454:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050125.906456:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:3.0:1789050125.906522:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+16:12175:x1875954704128128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1653us (1932us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789050125.906758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:0.0:1789050125.909853:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050125.909968:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050125.910070:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128384 00000100:00100000:3.0:1789050125.910079:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128384 00000100:00100000:3.0:1789050125.910136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:3.0:1789050125.910145:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:12175:x1875954704128384:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789050125.910259:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:12175:x1875954704128384:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 115us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.910267:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:2.0:1789050125.911444:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128256 00000100:00100000:2.0:1789050125.911455:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128256 00000100:00100000:2.0:1789050125.911515:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789050125.911524:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+16:2403:x1875954704128256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050125.911538:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050125.911562:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57da1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c5f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050125.911582:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:2.0:1789050125.911586:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050125.911685:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+15:2403:x1875954704128256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 162us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050125.911694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000001:00080000:1.0:1789050125.914400:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000020:00080000:1.0:1789050125.914415:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789050125.914527:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789050125.914544:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789050125.922468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050125.922618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128512 00000100:00100000:3.0:1789050125.922642:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128512 00000100:00100000:3.0:1789050125.922751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:3.0:1789050125.922762:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:12175:x1875954704128512:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789050125.922889:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:12175:x1875954704128512:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 128us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.922897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00080000:0.0:1789050125.923899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050125.929248:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714677760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929366:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714678272:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929384:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929398:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714678784:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929443:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789050125.929449:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714677376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929487:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929505:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714677888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929523:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714678400:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929563:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714678912:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.929604:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678272 00000100:00100000:3.0:1789050125.929611:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678272 00000100:00100000:3.0:1789050125.929643:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678784 00000100:00100000:3.0:1789050125.929645:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678784 00000100:00100000:3.0:1789050125.929677:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678400 00000100:00100000:3.0:1789050125.929679:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678400 00000100:00100000:3.0:1789050125.929688:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678912 00000100:00100000:3.0:1789050125.929690:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678912 00000100:00100000:3.0:1789050125.929702:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789050125.929709:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714678272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929752:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714678272:12345-0@lo:400:kworker.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.929759:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789050125.929775:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789050125.929780:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714678784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929800:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714678784:12345-0@lo:400:kworker.0 Request processed in 21us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.929805:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789050125.929814:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789050125.929819:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714678400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929837:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714678400:12345-0@lo:400:kworker.0 Request processed in 18us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.929842:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789050125.929850:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789050125.929855:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714678912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.929883:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714678912:12345-0@lo:400:kworker.0 Request processed in 18us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.929888:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789050125.929907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677376 00000100:00100000:3.0:1789050125.929910:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677376 00000100:00100000:3.0:1789050125.929929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789050125.929963:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714677376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931206:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677888 00000100:00100000:1.0:1789050125.931219:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677888 00000100:00100000:1.0:1789050125.931259:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789050125.931267:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714677888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931322:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714677888:12345-0@lo:400:kworker.0 Request processed in 56us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.931340:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789050125.931366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714677632:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931399:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714678144:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931453:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714678656:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789050125.931520:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714677504:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714678016:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714678528:0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931592:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931607:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714679040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050125.931627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050125.931650:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677760 00000100:00100000:1.0:1789050125.931654:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677760 00000100:00100000:1.0:1789050125.931670:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678144 00000100:00100000:1.0:1789050125.931673:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678144 00000100:00100000:1.0:1789050125.931686:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678656 00000100:00100000:1.0:1789050125.931688:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678656 00000100:00100000:1.0:1789050125.931697:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677504 00000100:00100000:1.0:1789050125.931699:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677504 00000100:00100000:1.0:1789050125.931708:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678016 00000100:00100000:1.0:1789050125.931710:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678016 00000100:00100000:1.0:1789050125.931729:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714678528 00000100:00100000:1.0:1789050125.931732:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714678528 00000100:00100000:1.0:1789050125.931744:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789050125.931750:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714677760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931781:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714677760:12345-0@lo:400:kworker.0 Request processed in 32us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.931787:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789050125.931797:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789050125.931803:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714678144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931830:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714678144:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.931835:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789050125.931844:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789050125.931849:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714678656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931885:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714678656:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.931891:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789050125.931901:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789050125.931907:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714677504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050125.931929:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714677504:12345-0@lo:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.931934:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789050125.932123:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714677376:12345-0@lo:400:kworker.0 Request processed in 2160us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.932131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789050125.932273:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714677632 00000100:00100000:0.0:1789050125.932278:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714677632 00000100:00100000:0.0:1789050125.932305:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789050125.932311:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714677632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050125.932346:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714677632:12345-0@lo:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050125.932352:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000040:00080000:2.0:1789050125.932495:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050125.932891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789050125.932901:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714678016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.932953:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714678016:12345-0@lo:400:kworker.0 Request processed in 38us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.932959:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789050125.932973:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789050125.932979:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714678528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933013:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714678528:12345-0@lo:400:kworker.0 Request processed in 25us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.933019:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789050125.933036:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714679040 00000100:00100000:3.0:1789050125.933040:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714679040 00000100:00100000:3.0:1789050125.933064:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789050125.933070:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714679040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050125.933091:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789050125.933117:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714679040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.933123:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789050125.933168:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050125.933180:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714679168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050125.933206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.933260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714677504:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933270:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714678016:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714678528:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933287:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789050125.933292:0:3647:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789050125.933312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714679040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050125.933322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714677632:0@lo:400:kworker.0 00010000:00080000:3.0:1789050125.933334:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983e25500 x1875954714678144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050125.933344:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714678144:0@lo:400:kworker.0 00010000:00080000:3.0:1789050125.933353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983e25180 x1875954714678656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050125.933361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714678656:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714677376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933400:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714677888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714678400:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933418:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714678912:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714677760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933436:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714678272:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933444:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714678784:0@lo:400:kworker.0 00000100:00100000:3.0:1789050125.933477:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714679168 00000100:00100000:3.0:1789050125.933480:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714679168 00000100:00100000:3.0:1789050125.933499:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789050125.933504:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714679168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050125.933514:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789050125.933539:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714679168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.933545:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789050125.933568:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714679168:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789050125.934402:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050125.934407:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050125.934410:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789050126.505356:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050126.633079:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050126.633091:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050126.633500:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789050126.633509:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050126.793827:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050126.793892:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050126.793917:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128640 00000100:00100000:2.0:1789050126.793925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050126.793928:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128640 00000100:00100000:2.0:1789050126.793975:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050126.793998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 382 00000100:00100000:3.0:1789050126.794011:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704128640:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.794020:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050126.794561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050126.796105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050126.796264:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128896 00000100:00100000:2.0:1789050126.796272:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128896 00000100:00100000:2.0:1789050126.796315:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129408 00000100:00100000:2.0:1789050126.796318:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129408 00000100:00100000:2.0:1789050126.796343:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128768 00000100:00100000:2.0:1789050126.796346:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128768 00000100:00100000:2.0:1789050126.796357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129280 00000100:00100000:2.0:1789050126.796359:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129280 00000100:00100000:2.0:1789050126.796375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 307 00000100:00100000:2.0:1789050126.796384:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704128896:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796441:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704128896:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 59us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796449:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 307 00000100:00100000:2.0:1789050126.796465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 308 00000100:00100000:2.0:1789050126.796471:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704129408:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796501:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704129408:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796507:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 308 00000100:00100000:2.0:1789050126.796519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 309 00000100:00100000:2.0:1789050126.796525:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2404:x1875954704128768:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796549:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2404:x1875954704128768:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796555:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 309 00000100:00100000:2.0:1789050126.796573:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 310 00000100:00100000:2.0:1789050126.796580:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704129280:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796608:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2404:x1875954704129280:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 310 00000100:00100000:2.0:1789050126.796631:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129152 00000100:00100000:2.0:1789050126.796635:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129152 00000100:00100000:2.0:1789050126.796676:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129024 00000100:00100000:2.0:1789050126.796679:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129024 00000100:00100000:2.0:1789050126.796698:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:2.0:1789050126.796704:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704129152:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796731:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704129152:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796737:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:2.0:1789050126.796747:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:2.0:1789050126.796753:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704129024:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050126.796774:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704129024:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 21us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050126.796779:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00080000:2.0:1789050126.797037:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050126.797041:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050126.797044:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050126.797046:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050126.798587:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2404:x1875954704128640:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 4570us (4761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050126.798601:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 382 00010000:00010000:1.0:1789050127.532302:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050127.750615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050127.751758:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129536 00000100:00100000:2.0:1789050127.751774:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129536 00000100:00100000:2.0:1789050127.751928:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:2.0:1789050127.751953:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:12217:x1875954704129536:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050127.751982:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050127.752004:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752084:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752097:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752112:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752119:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752127:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752172:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752180:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752187:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752194:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050127.752205:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752213:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752225:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050127.752228:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050127.752232:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752239:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752252:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752258:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752264:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752270:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050127.752273:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752279:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752287:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baaae575300) 00010000:00010000:2.0:1789050127.752290:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050127.752299:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752305:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57dbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752337:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57daf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c66 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752347:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050127.752350:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050127.752353:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c66 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.752363:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694000, rc 0) 00000100:00100000:2.0:1789050127.752425:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:12217:x1875954704129536:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 487us (1819us total) trans 0 rc 301/301 00000100:00100000:2.0:1789050127.752431:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00080000:3.0:1789050127.756186:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050127.763271:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050127.763345:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129792 00000100:00100000:2.0:1789050127.763355:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129792 00000100:00100000:2.0:1789050127.763421:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 153 00000100:00100000:2.0:1789050127.763432:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+13:12217:x1875954704129792:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1789050127.763492:0:13807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050127.763522:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a91 expref: 13 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763540:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbb400) 00010000:00010000:2.0:1789050127.763557:0:13807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050127.763626:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763640:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763651:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763664:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763671:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.763678:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764231:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764242:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764250:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050127.764265:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d9134532 reply state 0000000055422a49 transno 4294967422 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764274:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764281:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050127.764289:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050127.764293:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789050127.764297:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789050127.764305:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764311:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764319:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764325:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050127.764329:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764336:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764345:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baaae575000) 00010000:00010000:2.0:1789050127.764347:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050127.764351:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764357:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57dc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050127.764372:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d9134532 reply state 0000000055422a49 transno 4294967422 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764381:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.764398:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baaae575c00) 00010000:00010000:2.0:1789050127.764401:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050127.764403:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789050127.764491:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+14:12217:x1875954704129792:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 1059us (1229us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789050127.764500:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 153 00000100:00100000:1.0:1789050127.877530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050127.877651:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129920 00000100:00100000:3.0:1789050127.877661:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129920 00000100:00100000:3.0:1789050127.877725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 154 00000100:00100000:3.0:1789050127.877735:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+14:12225:x1875954704129920:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:3.0:1789050127.877769:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050127.877789:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c6d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.877853:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.877888:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.877902:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050127.877992:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789050127.877996:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050127.878017:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.878041:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c6d expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.878060:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c6d expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.878069:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050127.878072:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050127.878075:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043000, rc 0) 00000100:00100000:3.0:1789050127.878132:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+15:12225:x1875954704129920:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 399us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050127.878139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 154 00000100:00100000:2.0:1789050127.967083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050127.967220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130048 00000100:00100000:3.0:1789050127.967229:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130048 00000100:00100000:3.0:1789050127.967306:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 155 00000100:00100000:3.0:1789050127.967318:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+15:12231:x1875954704130048:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050127.967338:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050127.967357:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967421:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967435:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967460:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967472:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967480:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967487:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967569:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967577:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967605:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050127.967653:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789050127.967657:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050127.967677:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967689:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967695:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967701:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967707:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050127.967712:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967720:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967731:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050127.967734:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050127.967739:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967745:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57dee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967770:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967776:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967781:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967786:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050127.967789:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967794:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967802:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baaae575c00) 00010000:00010000:3.0:1789050127.967805:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050127.967808:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967814:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df57df5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967850:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c74 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967874:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c74 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.967892:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050127.967894:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789050127.967897:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177600, rc 0) 00000100:00100000:3.0:1789050127.968019:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+16:12231:x1875954704130048:12345-192.168.203.42@tcp:101:bash.0 Request processed in 703us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050127.968028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 155 00000100:00100000:1.0:1789050127.970895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050127.971161:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130304 00000100:00100000:2.0:1789050127.971171:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130304 00000100:00100000:2.0:1789050127.971228:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 156 00000100:00100000:2.0:1789050127.971239:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+16:12231:x1875954704130304:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050127.971258:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050127.971277:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57e03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c7b expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.971388:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.971402:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.971413:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.973774:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.973796:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.974270:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050127.975170:0:13807:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789050127.975401:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975413:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975422:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975456:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975462:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975469:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975474:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050127.975479:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975486:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975498:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050127.975501:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050127.975519:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975525:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050127.975538:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002845a3a3 reply state 00000000cbcd2dea transno 4294967423 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975550:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975556:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:2.0:1789050127.975559:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050127.975563:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050127.975598:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df57e03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 19 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975616:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 18 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.975624:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050127.975626:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050127.975628:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694600, rc 0) 00000100:00100000:2.0:1789050127.975770:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+19:12231:x1875954704130304:12345-192.168.203.42@tcp:101:bash.0 Request processed in 4532us (4883us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789050127.975780:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 156 00000100:00100000:2.0:1789050127.981511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050127.981599:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130432 00000100:00100000:3.0:1789050127.981609:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130432 00000100:00100000:3.0:1789050127.981691:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:3.0:1789050127.981701:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704130432:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050127.981723:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050127.981786:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c82 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050127.981811:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050127.981844:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1789050127.981849:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050127.981867:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.981886:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.981900:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177000, rc 0) 00000100:00100000:3.0:1789050127.982425:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2405:x1875954704130432:12345-192.168.203.42@tcp:101:bash.0 Request processed in 592us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050127.982456:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:1.0:1789050127.986030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050127.986397:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130560 00000100:00100000:2.0:1789050127.986407:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130560 00000100:00100000:2.0:1789050127.986566:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789050127.986577:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:12231:x1875954704130560:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050127.986595:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050127.986615:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c89 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.986648:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.986658:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050127.986662:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050127.986668:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.986726:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.986740:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 7 pid: 8629 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050127.986756:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714679296:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050127.986883:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050127.991687:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050127.991843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130688 00000100:00100000:3.0:1789050127.991853:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130688 00010000:00010000:3.0:1789050127.991905:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 8 pid: 8629 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050127.991994:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:3.0:1789050127.992005:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704130688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050127.992020:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050127.992041:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 8 pid: 8629 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.992055:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 8 pid: 8629 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.992080:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050127.992084:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050127.992093:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.992103:0:6504:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050127.992141:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050127.992179:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1875954714679424:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789050127.992259:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d900 going to sleep for 11 seconds 00010000:00010000:2.0:1789050127.993311:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0546970/0x3b8ec5973df57e26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c82 expref: 8 pid: 8629 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050127.993333:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714679296:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050127.993370:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050127.993380:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694000, rc 0) 00000100:00100000:2.0:1789050127.993430:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:12231:x1875954704130560:12345-192.168.203.42@tcp:101:bash.0 Request processed in 6855us (7410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050127.993437:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:1.0:1789050128.000692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.000770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130944 00000100:00100000:0.0:1789050128.000781:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130944 00000100:00100000:0.0:1789050128.000849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:0.0:1789050128.000885:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:12231:x1875954704130944:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:0.0:1789050128.001132:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000100:00100000:0.0:1789050128.001235:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:12231:x1875954704130944:12345-192.168.203.42@tcp:35:bash.0 Request processed in 352us (554us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1789050128.001243:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000020:00080000:0.0:1789050128.001248:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050128.001530:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1875954714679424:192.168.203.42@tcp:105: 00010000:00010000:3.0:1789050128.001552:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050128.001577:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704130688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9575us (9900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.001585:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:3.0:1789050128.109350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.109761:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131200 00000100:00100000:0.0:1789050128.109771:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131200 00000100:00100000:0.0:1789050128.109836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 157 00000100:00100000:0.0:1789050128.109846:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:12241:x1875954704131200:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050128.109881:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050128.109902:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df57e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050128.110198:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789050128.110323:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df57e34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c90 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.110338:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:0.0:1789050128.110341:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050128.110346:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df57e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c90 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.110359:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0a00, rc 0) 00000100:00100000:0.0:1789050128.110569:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+22:12241:x1875954704131200:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 724us (1229us total) trans 4294967426 rc 301/301 00000100:00100000:0.0:1789050128.110576:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 157 00000100:00100000:1.0:1789050128.114654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.114771:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131456 00000100:00100000:0.0:1789050128.114782:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131456 00000100:00100000:0.0:1789050128.114878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789050128.114889:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+22:12241:x1875954704131456:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050128.115681:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:12241:x1875954704131456:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 790us (1034us total) trans 4294967427 rc 0/0 00000100:00100000:0.0:1789050128.115690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:2.0:1789050128.187182:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.187262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131584 00000100:00100000:3.0:1789050128.187271:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131584 00000100:00100000:3.0:1789050128.187343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 158 00000100:00100000:3.0:1789050128.187353:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:12247:x1875954704131584:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050128.187375:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050128.187395:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c97 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187455:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187470:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187481:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050128.187523:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789050128.187544:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050128.187568:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187594:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c97 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187613:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c97 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.187622:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050128.187625:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050128.187628:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043e00, rc 0) 00000100:00100000:3.0:1789050128.188281:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+24:12247:x1875954704131584:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 925us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.188300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 158 00000100:00100000:3.0:1789050128.193167:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.193313:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131840 00000100:00100000:2.0:1789050128.193326:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131840 00000100:00100000:2.0:1789050128.193393:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:2.0:1789050128.193403:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+24:12247:x1875954704131840:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050128.193425:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050128.193447:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966c9e expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.193566:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57e57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.193581:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57e57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.193594:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57e57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050128.193607:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789050128.193716:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df57e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c9e expref: 27 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.193756:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57e57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c9e expref: 26 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.193766:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050128.193770:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050128.193773:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694a00, rc 0) 00000100:00100000:2.0:1789050128.193836:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+26:12247:x1875954704131840:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 434us (677us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1789050128.193843:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:2.0:1789050128.197328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050128.197423:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132224 00000100:00100000:1.0:1789050128.197433:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132224 00000100:00100000:1.0:1789050128.197504:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789050128.197514:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+26:2404:x1875954704132224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050128.197531:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050128.197555:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57e57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c9e expref: 26 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.197575:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:1.0:1789050128.197579:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050128.197634:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+25:2404:x1875954704132224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 122us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.197642:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789050128.200215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.200308:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132096 00000100:00100000:3.0:1789050128.200318:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132096 00000100:00100000:3.0:1789050128.200382:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:3.0:1789050128.200393:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+25:12247:x1875954704132096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050128.200415:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050128.200435:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57e65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.200539:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.200553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.200580:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050128.200594:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789050128.200699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57e65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ca5 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.200718:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ca5 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.200727:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:3.0:1789050128.200730:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789050128.200733:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7e00, rc 0) 00000100:00100000:3.0:1789050128.200789:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+27:12247:x1875954704132096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 398us (587us total) trans 4294967429 rc 0/0 00000100:00100000:3.0:1789050128.200796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:3.0:1789050128.206973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.207109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132352 00000100:00100000:2.0:1789050128.207119:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132352 00000100:00100000:2.0:1789050128.207188:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789050128.207199:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+6:2403:x1875954704132352:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1789050128.207243:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.207263:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.207273:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050128.207277:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050128.207282:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.207348:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.207362:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 6 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.207378:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983df8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1875954714679552:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050128.207478:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f600 going to sleep for 11 seconds 00000100:00080000:0.0:1789050128.207799:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050128.210901:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983df8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1875954714679552:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050128.210931:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050128.213987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.216059:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132480 00000100:00100000:2.0:1789050128.216074:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132480 00002000:00100000:2.0:1789050128.216129:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ba983d99c00 x1875954704132480/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:629/0 lens 504/0 e 0 to 0 dl 1789050139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050128.216141:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983d99c00 with x1875954704132480 ext(0->12) 00010000:00010000:2.0:1789050128.216150:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 7 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.216166:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 7 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050128.216174:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983d99c00 00000100:00100000:2.0:1789050128.216258:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:2.0:1789050128.216269:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704132480:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:2.0:1789050128.217427:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704132480:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 1156us (3446us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789050128.217447:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00002000:00100000:2.0:1789050128.217457:0:8440:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ba983d99c00 x1875954704132480/t4294967306(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:629/0 lens 504/448 e 0 to 0 dl 1789050139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050128.217466:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983d99c00 with x1875954704132480 ext(0->12) 00010000:00010000:2.0:1789050128.217473:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.217487:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050128.217494:0:8440:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983d99c00 00000100:00100000:1.0:1789050128.224223:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.224333:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132608 00000100:00100000:0.0:1789050128.224344:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132608 00010000:00010000:0.0:1789050128.224384:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.224429:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789050128.224439:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+9:2405:x1875954704132608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050128.224455:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789050128.224472:0:7461:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789050128.224475:0:7461:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789050127078042772 00002000:00010000:0.0:1789050128.224478:0:7461:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789050127282876760 00002000:00010000:0.0:1789050128.224480:0:7461:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789050127078042772 00002000:00010000:0.0:1789050128.224482:0:7461:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789050128.224489:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.224502:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.224545:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776af74f/0x3b8ec5973df57e2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c89 expref: 9 pid: 8432 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.224567:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050128.224572:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050128.224578:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.224587:0:7461:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.224733:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050128.224796:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+8:2405:x1875954704132608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 358us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.224804:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00010000:00010000:3.0:1789050128.225678:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225691:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225726:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225734:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225743:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225750:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050128.225754:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225763:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225779:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.225786:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df57e7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050128.225911:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704132352:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 18712us (18980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.225920:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789050128.233851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.233967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132864 00000100:00100000:2.0:1789050128.233978:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132864 00000100:00100000:2.0:1789050128.234046:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789050128.234057:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+27:12247:x1875954704132864:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:2.0:1789050128.234148:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ca5 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050128.234557:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000001:00080000:2.0:1789050128.234595:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000001:00080000:2.0:1789050128.234900:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789050128.234976:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.235126:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 31 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.235150:0:6521:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.235188:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 31 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.235202:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 31 pid: 13807 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.235217:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714679680:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050128.235426:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.241738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.242253:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132992 00000100:00100000:0.0:1789050128.242263:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132992 00010000:00010000:0.0:1789050128.242363:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 32 pid: 13807 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.242442:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:0.0:1789050128.242453:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+32:2404:x1875954704132992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050128.242469:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050128.242477:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 32 pid: 13807 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.242510:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 32 pid: 13807 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.242533:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:0.0:1789050128.242539:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.242549:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.242557:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.242578:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050128.242713:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57e18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c7b expref: 32 pid: 13807 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.242732:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1875954714679680:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050128.242756:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.242765:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.242772:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050128.242895:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00000001:00080000:2.0:1789050128.243055:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967434 00000100:00100000:2.0:1789050128.243140:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714679808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050128.243196:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050128.243223:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.243274:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714679808 00000100:00100000:2.0:1789050128.243280:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714679808 00000100:00100000:2.0:1789050128.243333:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789050128.243341:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714679808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050128.243411:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714679808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.243419:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789050128.243457:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714679808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789050128.243552:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00000100:00100000:2.0:1789050128.243590:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714679936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050128.243613:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050128.243629:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87571240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.243650:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714679936 00000100:00100000:2.0:1789050128.243654:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714679936 00000100:00100000:2.0:1789050128.243676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789050128.243683:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875954714679936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050128.243764:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875954714679936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (149us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789050128.243770:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789050128.243802:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1875954714679936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789050128.243830:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967436 00010000:00010000:2.0:1789050128.243855:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243874:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243889:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243895:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050128.243899:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243906:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243918:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050128.243921:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789050128.243932:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.243964:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57e81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050128.244047:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789050128.244110:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789050128.244120:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350442181909ns, next at 351442179591ns, rc = 0 00000001:00080000:2.0:1789050128.244125:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967437 00010000:00010000:2.0:1789050128.244166:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050128.244169:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789050128.244175:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57e6c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ca5 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.244301:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+35:2404:x1875954704132992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1849us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.244310:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:2.0:1789050128.244616:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+34:12247:x1875954704132864:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 10560us (10774us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789050128.244635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000020:00080000:2.0:1789050128.244639:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1789050128.244677:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050128.247782:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050128.247870:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133120 00000100:00100000:1.0:1789050128.247881:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133120 00000100:00100000:1.0:1789050128.248227:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:1.0:1789050128.248237:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+34:12247:x1875954704133120:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050128.248261:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050128.248303:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cac expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.248357:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cac expref: 35 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.248372:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cac expref: 35 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.248387:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:1.0:1789050128.248391:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050128.248394:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570a00, rc 0) 00000100:00100000:1.0:1789050128.248447:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+35:12247:x1875954704133120:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 212us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.248454:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:2.0:1789050128.251372:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.251459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133376 00000100:00100000:0.0:1789050128.251470:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133376 00000100:00100000:0.0:1789050128.251527:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:0.0:1789050128.251538:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+35:12247:x1875954704133376:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050128.251768:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+36:12247:x1875954704133376:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 231us (405us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789050128.251776:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:2.0:1789050128.350096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.350178:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133632 00000100:00100000:3.0:1789050128.350188:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133632 00000100:00100000:3.0:1789050128.350251:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:3.0:1789050128.350261:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+36:12257:x1875954704133632:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050128.350294:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050128.350312:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cb3 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050128.350413:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789050128.350506:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57e8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cb3 expref: 38 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.350520:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050128.350523:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050128.350528:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cb3 expref: 38 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.350541:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6e00, rc 0) 00000100:00100000:3.0:1789050128.350602:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+37:12257:x1875954704133632:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 342us (516us total) trans 4294967440 rc 301/301 00000100:00100000:3.0:1789050128.350609:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:3.0:1789050128.354274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.354375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133760 00000100:00100000:0.0:1789050128.354384:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133760 00000100:00100000:0.0:1789050128.354453:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 163 00000100:00100000:0.0:1789050128.354462:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+37:12257:x1875954704133760:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:0.0:1789050128.354537:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354554:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354566:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354576:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354584:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354591:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354662:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354670:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354677:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050128.354723:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354735:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354748:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354755:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354762:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050128.354766:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354774:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354785:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050128.354788:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050128.354792:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354798:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57e9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354811:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354816:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354822:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354828:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050128.354837:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354842:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354850:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:0.0:1789050128.354852:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050128.354865:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354872:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ea4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354882:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354888:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354894:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354899:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050128.354902:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354907:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354913:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050128.354915:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050128.354924:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.354992:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.355059:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+37:12257:x1875954704133760:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 597us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.355067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 163 00000100:00100000:2.0:1789050128.358374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.358462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134016 00000100:00100000:0.0:1789050128.358471:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134016 00000100:00100000:0.0:1789050128.358528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:0.0:1789050128.358539:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+37:12257:x1875954704134016:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050128.358787:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+38:12257:x1875954704134016:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 250us (423us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789050128.358795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:2.0:1789050128.394154:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.394248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134272 00000100:00100000:3.0:1789050128.394258:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134272 00000100:00100000:3.0:1789050128.394329:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:3.0:1789050128.394339:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+38:12260:x1875954704134272:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050128.394363:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050128.394394:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57eb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394463:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394476:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394488:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394499:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394507:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394514:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394611:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394619:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394626:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050128.394636:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789050128.394705:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394724:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394731:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394737:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050128.394741:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394749:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394761:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050128.394764:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050128.394769:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394776:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57eb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394788:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394794:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394799:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394804:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050128.394812:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394819:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394841:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:3.0:1789050128.394844:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050128.394848:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394854:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394903:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57eb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394917:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.394924:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050128.394926:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050128.394928:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043200, rc 0) 00000100:00100000:3.0:1789050128.395432:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+40:12260:x1875954704134272:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1092us (1285us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789050128.395440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:3.0:1789050128.403355:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.403693:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134400 00000100:00100000:2.0:1789050128.403703:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134400 00000100:00100000:2.0:1789050128.403767:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:2.0:1789050128.403777:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+40:12260:x1875954704134400:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050128.403842:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403868:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403879:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403916:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403924:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403931:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.403964:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050128.403981:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.404001:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.404014:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050128.404017:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050128.404021:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.404028:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df57ed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.404109:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+40:12260:x1875954704134400:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 333us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.404117:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:1.0:1789050128.407925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.408158:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134656 00000100:00100000:0.0:1789050128.408169:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134656 00000100:00100000:0.0:1789050128.408224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789050128.408234:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+40:12260:x1875954704134656:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050128.408492:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+41:12260:x1875954704134656:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 258us (576us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789050128.408500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:2.0:1789050128.489831:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050128.489865:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714680064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050128.489981:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.490151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714680064 00000100:00100000:0.0:1789050128.490159:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714680064 00000100:00100000:0.0:1789050128.490210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789050128.490220:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714680064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789050128.490251:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789050128.490326:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714680064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.490333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789050128.490475:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714680064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789050128.553529:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050128.757000:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.757127:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134912 00000100:00100000:0.0:1789050128.757137:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134912 00000100:00100000:0.0:1789050128.757193:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:0.0:1789050128.757202:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+41:12291:x1875954704134912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1789050128.757227:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050128.757246:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57edc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.757348:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.757362:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.757373:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050128.757385:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789050128.757473:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57edc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc1 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.757489:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc1 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.757498:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050128.757501:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050128.757519:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1a00, rc 0) 00000100:00100000:0.0:1789050128.757636:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+43:12291:x1875954704134912:12345-192.168.203.42@tcp:101:cat.0 Request processed in 434us (650us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789050128.757644:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:3.0:1789050128.761793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.761841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050128.761977:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135168 00000100:00100000:0.0:1789050128.761987:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135168 00000100:00100000:0.0:1789050128.762050:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:0.0:1789050128.762060:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+43:12291:x1875954704135168:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1789050128.762061:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135296 00000100:00100000:2.0:1789050128.762065:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135296 00000100:00100000:2.0:1789050128.762098:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789050128.762104:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+44:2406:x1875954704135296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050128.762113:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050128.762134:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc1 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.762152:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050128.762171:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050128.762217:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+44:2406:x1875954704135296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.762223:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789050128.762292:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+43:12291:x1875954704135168:12345-192.168.203.42@tcp:35:cat.0 Request processed in 224us (497us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789050128.762300:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:2.0:1789050128.836629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050128.836757:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135552 00000100:00100000:1.0:1789050128.836768:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135552 00000100:00100000:1.0:1789050128.837394:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:1.0:1789050128.837420:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+43:12297:x1875954704135552:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:1.0:1789050128.837443:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050128.837447:0:10357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789050128.837486:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df57e49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c97 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.837539:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:1.0:1789050128.837545:0:10357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050128.837559:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571e00/0x3b8ec5973df57ef1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cc8 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.838023:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.838050:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.838060:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.838160:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.838176:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 43 pid: 6518 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.838192:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714680192:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050128.838421:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.844340:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714680192:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050128.844370:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.849388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050128.849506:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135680 00000100:00100000:1.0:1789050128.849517:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135680 00010000:00010000:1.0:1789050128.849560:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 44 pid: 6518 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.849630:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:1.0:1789050128.849640:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+44:2404:x1875954704135680:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050128.849656:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050128.849662:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 44 pid: 6518 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849674:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 44 pid: 6518 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849695:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df57ec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cba expref: 44 pid: 6518 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849711:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:1.0:1789050128.849717:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849726:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849733:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.849770:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050128.849895:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.849904:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050128.849925:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789050128.850103:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571e00/0x3b8ec5973df57ef1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 45 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.850120:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 44 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.850128:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050128.850131:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050128.850134:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571000, rc 0) 00000100:00100000:1.0:1789050128.850271:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+44:2404:x1875954704135680:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 631us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.850280:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789050128.850821:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+43:12297:x1875954704135552:12345-192.168.203.42@tcp:101:dd.0 Request processed in 13416us (14202us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789050128.850830:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:1.0:1789050128.858248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050128.858387:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135808 00000100:00100000:2.0:1789050128.858397:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135808 00000100:00100000:2.0:1789050128.858457:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:2.0:1789050128.858468:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+43:12297:x1875954704135808:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:2.0:1789050128.858713:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050128.858734:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ccf expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.858839:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.858864:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.858878:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.859173:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 45 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.859191:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 44 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.859200:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050128.859203:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050128.859206:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694e00, rc 0) 00000100:00100000:2.0:1789050128.859309:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+44:12297:x1875954704135808:12345-192.168.203.42@tcp:101:dd.0 Request processed in 843us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.859316:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:0.0:1789050128.864268:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050128.864364:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136064 00000100:00100000:3.0:1789050128.864388:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136064 00000100:00100000:3.0:1789050128.864500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:3.0:1789050128.864512:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+44:12297:x1875954704136064:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:3.0:1789050128.864743:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.864831:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.864845:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050128.864897:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967447 00000004:00010000:3.0:1789050128.864922:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f5cd2280 reply state 00000000e6d1ec7b transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.865118:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.865128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050128.865131:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050128.865135:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050128.865232:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+47:12297:x1875954704136064:12345-192.168.203.42@tcp:36:dd.0 Request processed in 721us (973us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789050128.865239:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 169 00000020:00080000:3.0:1789050128.865243:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050129.001493:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050129.001520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714680320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050129.001589:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050129.004881:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714680320 00000100:00100000:2.0:1789050129.004896:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714680320 00000100:00100000:2.0:1789050129.005190:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789050129.005202:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714680320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050129.005241:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050129.005333:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714680320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050129.005340:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789050129.005449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714680320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050129.167663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.167753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136192 00000100:00100000:3.0:1789050129.167764:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136192 00000100:00100000:3.0:1789050129.167875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:3.0:1789050129.167887:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+47:12311:x1875954704136192:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:3.0:1789050129.167914:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050129.167968:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57f1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168047:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168073:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168085:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168096:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168103:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168110:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168179:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168190:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 48 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168217:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168251:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 48 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.168266:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 48 pid: 10357 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050129.168282:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714680448:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050129.168652:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d600 going to sleep for 11 seconds 00000100:00080000:2.0:1789050129.168721:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050129.174923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.175068:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136448 00000100:00100000:2.0:1789050129.175077:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136448 00000100:00100000:2.0:1789050129.175139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:2.0:1789050129.175150:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+49:6175:x1875954704136448:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789050129.175248:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714680448:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050129.175277:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050129.175444:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+50:6175:x1875954704136448:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 296us (531us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789050129.175453:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789050129.182532:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.186446:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136576 00000100:00100000:3.0:1789050129.186467:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136576 00010000:00010000:3.0:1789050129.186528:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 50 pid: 10357 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050129.186596:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:3.0:1789050129.186608:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+50:2406:x1875954704136576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050129.186626:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050129.186633:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 50 pid: 10357 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.186671:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 50 pid: 10357 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.186699:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df57ef8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cc8 expref: 50 pid: 10357 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.186722:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050129.186729:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.186740:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.186749:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.188440:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050129.188531:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+49:2406:x1875954704136576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1920us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050129.188542:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00010000:00010000:0.0:1789050129.191897:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.191916:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050129.192123:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789050129.192127:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050129.192160:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192177:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192187:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192213:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192220:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192226:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050129.192231:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192239:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192256:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050129.192259:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050129.192264:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6800/0x3b8ec5973df57f22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192366:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192374:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192379:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192384:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050129.192394:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192401:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192410:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:0.0:1789050129.192412:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050129.192415:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192421:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df57f29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192460:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df57f1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cd6 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192475:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cd6 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.192482:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050129.192485:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050129.192488:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:0.0:1789050129.192628:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+48:12311:x1875954704136192:12345-192.168.203.42@tcp:101:stat.0 Request processed in 24742us (24975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050129.192637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:0.0:1789050129.282844:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.283630:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136832 00000100:00100000:2.0:1789050129.283642:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136832 00000100:00100000:2.0:1789050129.283774:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:2.0:1789050129.283786:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+48:12317:x1875954704136832:12345-192.168.203.42@tcp:36:truncate.0 00010000:00010000:2.0:1789050129.283878:0:13807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050129.283906:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cd6 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.283926:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.283932:0:13807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050129.284151:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.284172:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.284184:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050129.284243:0:13807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789050129.284274:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b60e5ce8 reply state 00000000ef18d7a7 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.284295:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.284301:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.284304:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050129.284307:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050129.284413:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+50:12317:x1875954704136832:12345-192.168.203.42@tcp:36:truncate.0 Request processed in 630us (1578us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789050129.284421:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000020:00080000:2.0:1789050129.284427:0:13807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050129.460431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050129.460546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136960 00000100:00100000:0.0:1789050129.460557:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136960 00000100:00100000:0.0:1789050129.460782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:0.0:1789050129.460809:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+50:12331:x1875954704136960:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:0.0:1789050129.460834:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050129.460864:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df57f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cdd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.460931:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.460965:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.460978:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.460990:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.460997:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461004:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461079:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461089:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461095:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050129.461147:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789050129.461152:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050129.461172:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461185:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461192:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461198:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461205:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461210:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050129.461215:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461223:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461236:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050129.461239:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050129.461245:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461251:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df57f45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461274:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461290:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461296:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461301:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050129.461304:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461310:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461318:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:0.0:1789050129.461320:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050129.461323:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461329:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df57f4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461357:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df57f3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 52 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461371:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.461389:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050129.461391:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050129.461394:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0400, rc 0) 00000100:00100000:0.0:1789050129.461512:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+51:12331:x1875954704136960:12345-192.168.203.42@tcp:101:stat.0 Request processed in 704us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050129.461520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:0.0:1789050129.568052:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050129.568190:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137216 00000100:00100000:1.0:1789050129.568200:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137216 00000100:00100000:1.0:1789050129.568263:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00100000:1.0:1789050129.568274:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+51:12341:x1875954704137216:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050129.568305:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050129.568326:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ce4 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050129.568425:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789050129.568527:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57f5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ce4 expref: 53 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050129.568541:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:1.0:1789050129.568544:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050129.568549:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571200/0x3b8ec5973df57f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ce4 expref: 53 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050129.568563:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571200, rc 0) 00000100:00100000:1.0:1789050129.569003:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+52:12341:x1875954704137216:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 729us (959us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789050129.569011:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 173 00010000:00010000:2.0:1789050129.579246:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050129.580237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.580354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137472 00000100:00100000:2.0:1789050129.580364:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137472 00000100:00100000:2.0:1789050129.580427:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:2.0:1789050129.580438:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+52:12341:x1875954704137472:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789050129.581179:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+53:12341:x1875954704137472:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 738us (944us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789050129.581189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:2.0:1789050129.699367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.699557:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137728 00000100:00100000:3.0:1789050129.699569:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137728 00000100:00100000:3.0:1789050129.699740:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:3.0:1789050129.699752:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+53:12347:x1875954704137728:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050129.699776:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050129.699796:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df57f68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ceb expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.700069:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.700086:0:14070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.700096:0:14070:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.700129:0:14070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.700143:0:14070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 54 pid: 6520 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050129.700157:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714680576:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050129.700376:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050129.705042:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714680576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050129.705074:0:14070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050129.705972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.706048:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137856 00000100:00100000:3.0:1789050129.706056:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137856 00010000:00010000:3.0:1789050129.706093:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 55 pid: 6520 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050129.706175:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:3.0:1789050129.706201:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+55:2403:x1875954704137856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050129.706217:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050129.706224:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 55 pid: 6520 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706246:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 55 pid: 6520 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706267:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df57f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cdd expref: 55 pid: 6520 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706292:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050129.706297:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706306:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706314:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.706343:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050129.706403:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+54:2403:x1875954704137856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 203us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050129.706411:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00010000:00010000:2.0:1789050129.707114:0:14070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.707124:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050129.707143:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789050129.707290:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df57f68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 55 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.707306:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 54 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.707314:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.707317:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050129.707319:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:2.0:1789050129.707358:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+54:12347:x1875954704137728:12345-192.168.203.42@tcp:101:bash.0 Request processed in 7609us (8001us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789050129.707365:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:2.0:1789050129.710456:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.710537:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138112 00000100:00100000:3.0:1789050129.710546:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138112 00000100:00100000:3.0:1789050129.710706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 175 00000100:00100000:3.0:1789050129.710716:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+54:12347:x1875954704138112:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:3.0:1789050129.710995:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.711013:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.711023:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050129.711065:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967455 00000004:00010000:3.0:1789050129.711086:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000008fa93461 reply state 00000000fff2005c transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.711098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.711105:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050129.711108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050129.711112:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050129.711197:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+57:12347:x1875954704138112:12345-192.168.203.42@tcp:36:bash.0 Request processed in 482us (750us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789050129.711204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 175 00000020:00080000:3.0:1789050129.711209:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050129.717931:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.718056:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138240 00000100:00100000:3.0:1789050129.718067:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138240 00000100:00100000:3.0:1789050129.718125:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:3.0:1789050129.718134:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:12347:x1875954704138240:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050129.718158:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050129.718177:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df57f84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cf2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.718467:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.718483:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 58 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.718492:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.718527:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 58 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.718541:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 58 pid: 14070 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050129.718556:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714680704:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050129.718701:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050129.722800:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050129.723003:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714680704:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050129.723029:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050129.723123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138368 00000100:00100000:0.0:1789050129.723130:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138368 00010000:00010000:0.0:1789050129.723164:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 59 pid: 14070 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050129.723203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:0.0:1789050129.723212:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+59:2404:x1875954704138368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050129.723226:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050129.723232:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 59 pid: 14070 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723244:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 59 pid: 14070 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723265:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df57f6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ceb expref: 59 pid: 14070 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723280:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050129.723301:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723312:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723320:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.723474:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050129.723530:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:2404:x1875954704138368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 318us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050129.723538:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00010000:00010000:3.0:1789050129.723747:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.723755:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050129.723810:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789050129.725166:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050129.725328:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.725368:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df57f84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cf2 expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.725388:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cf2 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.725397:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050129.725400:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050129.725403:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:0.0:1789050129.725538:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:12347:x1875954704138240:12345-192.168.203.42@tcp:101:bash.0 Request processed in 7404us (7614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050129.725547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:1.0:1789050129.728792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050129.729049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138624 00000100:00100000:0.0:1789050129.729060:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138624 00000100:00100000:0.0:1789050129.729170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789050129.729180:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+57:12347:x1875954704138624:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789050129.729411:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+58:12347:x1875954704138624:12345-192.168.203.42@tcp:35:bash.0 Request processed in 231us (626us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789050129.729419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789050129.814691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050129.814791:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138880 00000100:00100000:0.0:1789050129.814801:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138880 00000100:00100000:0.0:1789050129.814903:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 177 00000100:00100000:0.0:1789050129.814913:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+58:12357:x1875954704138880:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050129.814988:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050129.815009:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966cf9 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050129.815105:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789050129.815208:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57f92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cf9 expref: 60 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.815222:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:0.0:1789050129.815226:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050129.815231:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df57f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cf9 expref: 60 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050129.815244:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1a00, rc 0) 00000100:00100000:0.0:1789050129.815307:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+59:12357:x1875954704138880:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 395us (625us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1789050129.815314:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 177 00000100:00100000:1.0:1789050129.818426:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.819136:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139008 00000100:00100000:2.0:1789050129.819148:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139008 00000100:00100000:2.0:1789050129.819213:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 178 00000100:00100000:2.0:1789050129.819224:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+59:12357:x1875954704139008:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789050129.819407:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819433:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819447:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819460:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819467:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819474:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819722:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819732:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819741:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050129.819791:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819804:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819810:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819827:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819834:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.819838:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819857:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819869:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050129.819872:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050129.819877:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819883:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819895:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819901:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819907:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819912:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.819914:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819963:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819972:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:2.0:1789050129.819983:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050129.819987:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.819993:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820005:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820010:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820015:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820020:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.820023:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820029:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820035:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.820038:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050129.820040:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.820056:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050129.820123:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+59:12357:x1875954704139008:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 900us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050129.820131:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 178 00000100:00100000:1.0:1789050129.823504:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.823686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139264 00000100:00100000:2.0:1789050129.823696:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139264 00000100:00100000:2.0:1789050129.823749:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789050129.823760:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+59:12357:x1875954704139264:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789050129.824017:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+60:12357:x1875954704139264:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 259us (521us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789050129.824024:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:1.0:1789050129.864010:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.864144:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139520 00000100:00100000:2.0:1789050129.864153:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139520 00000100:00100000:2.0:1789050129.864216:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:2.0:1789050129.864226:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+60:12360:x1875954704139520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050129.864248:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050129.864268:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d00 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864348:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864362:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864392:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864402:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864409:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864415:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864514:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57fca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864523:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57fca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864530:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57fca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050129.864539:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789050129.864623:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864630:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864637:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864643:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.864654:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864661:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864674:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050129.864677:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050129.864681:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864688:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df57fbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864702:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864708:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864714:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864719:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.864722:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864728:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864735:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:2.0:1789050129.864737:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050129.864747:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864753:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57fc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864789:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d00 expref: 63 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864802:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57fca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d00 expref: 62 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.864809:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.864811:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050129.864814:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695400, rc 0) 00000100:00100000:2.0:1789050129.864884:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+62:12360:x1875954704139520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 659us (882us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789050129.864892:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:1.0:1789050129.871747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050129.871957:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050129.872688:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139776 00000100:00100000:2.0:1789050129.872699:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139776 00000100:00100000:2.0:1789050129.872756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:2.0:1789050129.872767:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+62:12360:x1875954704139776:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050129.872833:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872863:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872876:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872932:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872972:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872990:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.872996:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050129.873000:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.873008:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.873020:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050129.873023:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050129.873028:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050129.873033:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050129.873102:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+62:12360:x1875954704139776:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 337us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050129.873109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:3.0:1789050129.881797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139648 00000100:00100000:3.0:1789050129.881812:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139648 00000100:00100000:3.0:1789050129.882018:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789050129.882029:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+62:2404:x1875954704139648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050129.882046:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789050129.882058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1789050129.882073:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df57fca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d00 expref: 62 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050129.882093:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050129.882098:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050129.882400:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+61:2404:x1875954704139648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 371us (10662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050129.882410:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789050129.882456:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140032 00000100:00100000:2.0:1789050129.882461:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140032 00000100:00100000:2.0:1789050129.882495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:2.0:1789050129.882504:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+61:12360:x1875954704140032:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789050129.883912:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+62:12360:x1875954704140032:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1403us (1850us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789050129.883924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:1.0:1789050130.048781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.048882:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140288 00000100:00100000:2.0:1789050130.048892:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140288 00000100:00100000:2.0:1789050130.049038:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:2.0:1789050130.049049:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+62:12378:x1875954704140288:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789050130.049071:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050130.049090:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d07 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.049186:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fe6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.049200:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.049211:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050130.049222:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789050130.049390:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57fdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d07 expref: 65 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.049407:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d07 expref: 64 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.049429:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.049432:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789050130.049437:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695a00, rc 0) 00000100:00100000:2.0:1789050130.049531:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+64:12378:x1875954704140288:12345-192.168.203.42@tcp:101:cat.0 Request processed in 483us (762us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789050130.049537:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:1.0:1789050130.079100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.079248:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140416 00000100:00100000:2.0:1789050130.079258:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140416 00000100:00100000:2.0:1789050130.079333:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00100000:2.0:1789050130.079344:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+64:12379:x1875954704140416:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050130.079370:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050130.079391:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d0e expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079454:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079469:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079480:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050130.079523:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789050130.079527:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050130.079546:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079606:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df57ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d0e expref: 66 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079626:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d0e expref: 65 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.079635:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050130.079638:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050130.079642:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695000, rc 0) 00000100:00100000:2.0:1789050130.079704:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+65:12379:x1875954704140416:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 362us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.079712:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00100000:1.0:1789050130.087290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050130.087445:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140800 00000100:00100000:0.0:1789050130.087468:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140800 00000100:00100000:0.0:1789050130.087524:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:0.0:1789050130.087535:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+65:12379:x1875954704140800:12345-192.168.203.42@tcp:35:lfs.0 00000001:00080000:0.0:1789050130.087806:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000100:00100000:0.0:1789050130.088197:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+67:12379:x1875954704140800:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 662us (914us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789050130.088205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000020:00080000:0.0:1789050130.088211:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050130.093372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.093722:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140928 00000100:00100000:3.0:1789050130.093732:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140928 00000100:00100000:3.0:1789050130.093853:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:3.0:1789050130.093863:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+67:12379:x1875954704140928:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:3.0:1789050130.093879:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789050130.093904:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df57f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cf2 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.093985:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df57fe6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d07 expref: 66 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.094004:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df57e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966cac expref: 65 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.094014:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050130.094020:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050130.094090:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+64:12379:x1875954704140928:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 228us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.094097:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789050130.096769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.097140:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141056 00000100:00100000:2.0:1789050130.097149:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141056 00000100:00100000:2.0:1789050130.097203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 183 00000100:00100000:2.0:1789050130.097212:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+64:12379:x1875954704141056:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:2.0:1789050130.097348:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.097364:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.097376:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050130.097474:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789050130.097654:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+64:12379:x1875954704141056:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 442us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.097672:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 183 00000100:00100000:1.0:1789050130.125744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.125987:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141184 00000100:00100000:2.0:1789050130.125999:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141184 00000100:00100000:2.0:1789050130.126059:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 184 00000100:00100000:2.0:1789050130.126070:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+64:12381:x1875954704141184:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050130.126089:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050130.126108:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df58009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d15 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126174:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126189:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126199:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126209:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126216:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126223:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126315:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126342:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126349:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050130.126391:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789050130.126396:0:14070:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050130.126415:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126427:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126436:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126443:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126449:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126455:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.126470:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126478:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126922:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050130.126932:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.126960:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126968:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58010 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126983:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126989:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.126995:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127000:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.127003:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127009:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127017:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:2.0:1789050130.127019:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.127022:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127028:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127057:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df58009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 66 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127085:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 65 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.127092:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.127095:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050130.127097:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694000, rc 0) 00000100:00100000:2.0:1789050130.127164:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+65:12381:x1875954704141184:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1095us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.127171:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 184 00000100:00100000:3.0:1789050130.537077:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714680832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050130.537150:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050130.537212:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714680832 00000100:00100000:1.0:1789050130.537220:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714680832 00000100:00100000:1.0:1789050130.537287:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789050130.537300:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714680832:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789050130.537361:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789050130.537403:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789050130.537458:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714680832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050130.537464:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789050130.537578:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714680832:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1789050130.538186:0:8628:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352736247183ns, next at 353736243902ns, rc = 0 00000100:00100000:0.0:1789050130.538257:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714680960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050130.538298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050130.538616:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714680960 00000100:00100000:3.0:1789050130.538622:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714680960 00000100:00100000:2.0:1789050130.539494:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789050130.539503:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714680960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050130.539522:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789050130.539572:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714680960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.539578:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789050130.545760:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050130.545839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714680960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789050130.606429:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050130.735165:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050130.735173:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050130.735198:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789050130.735204:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050130.735347:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983eab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714681088:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050130.735440:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa9149f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789050130.738080:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983eab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714681088:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789050130.750658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.750790:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141312 00000100:00100000:2.0:1789050130.750800:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141312 00000100:00100000:2.0:1789050130.750904:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 185 00000100:00100000:2.0:1789050130.750914:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+65:12393:x1875954704141312:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789050130.750996:0:10357:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789050130.751115:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+65:12393:x1875954704141312:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 202us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.751123:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 185 00000100:00100000:1.0:1789050130.756228:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.756349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141440 00000100:00100000:2.0:1789050130.756359:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141440 00000100:00100000:2.0:1789050130.756417:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 186 00000100:00100000:2.0:1789050130.756427:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+65:12393:x1875954704141440:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.756493:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756509:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756520:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756584:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756599:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756624:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756639:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050130.756684:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789050130.756702:0:6519:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050130.756714:0:6519:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756726:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756734:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756741:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756747:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.756751:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756758:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756770:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:2.0:1789050130.756773:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.756778:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756784:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756795:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756800:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756817:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756822:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.756825:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756831:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756851:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8baaae575300) 00010000:00010000:2.0:1789050130.756854:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.756858:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756864:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df5802c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756879:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756886:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756892:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756897:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.756900:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756915:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756922:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.756925:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.756961:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.756968:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.757057:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+65:12393:x1875954704141440:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 631us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.757065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 186 00000100:00100000:1.0:1789050130.760196:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.760236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141696 00000100:00100000:3.0:1789050130.760255:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141696 00000100:00100000:3.0:1789050130.760356:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:3.0:1789050130.760367:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+65:12393:x1875954704141696:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.760387:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050130.760406:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5803a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760507:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760523:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760535:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050130.760545:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789050130.760619:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760645:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760651:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760656:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050130.760660:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760666:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050130.760680:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050130.760685:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760692:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760734:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5803a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d1c expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760744:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:3.0:1789050130.760746:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050130.760750:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df5803a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d1c expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.760760:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050130.760826:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704141696:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 462us (639us total) trans 4294967465 rc 301/301 00000100:00100000:3.0:1789050130.760834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:1.0:1789050130.764587:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050130.764854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141824 00000100:00100000:0.0:1789050130.764863:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141824 00000100:00100000:0.0:1789050130.765003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 188 00000100:00100000:0.0:1789050130.765014:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704141824:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050130.765049:0:6518:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050130.765164:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704141824:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050130.765181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 188 00000100:00100000:1.0:1789050130.771905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.772366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142080 00000100:00100000:2.0:1789050130.772377:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142080 00000100:00100000:2.0:1789050130.772432:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:2.0:1789050130.772443:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704142080:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.772463:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050130.772466:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789050130.772492:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df57ffb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d0e expref: 66 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.772511:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050130.772516:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050130.772529:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5804f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050130.772981:0:6519:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789050130.773116:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.773129:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.773138:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.773185:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5804f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d23 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.773201:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d23 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.773208:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050130.773211:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050130.773214:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695a00, rc 0) 00000100:00100000:2.0:1789050130.775497:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+67:12393:x1875954704142080:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 3043us (3589us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789050130.775512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:1.0:1789050130.782576:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.783098:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142336 00000100:00100000:2.0:1789050130.783107:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142336 00000100:00100000:2.0:1789050130.783166:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789050130.783175:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+67:12393:x1875954704142336:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.783227:0:14070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050130.783266:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df58056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d23 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.783377:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575300) 00010000:00010000:2.0:1789050130.783388:0:14070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050130.783410:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.783423:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.783433:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785417:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785437:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785447:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785495:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785503:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785510:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785516:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.785537:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785545:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785556:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050130.785559:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.785563:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785569:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58064 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785582:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785588:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785593:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785598:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.785601:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785668:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785677:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8f8da797 (ffff8baaae575e00) 00010000:00010000:2.0:1789050130.785679:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.785689:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.785695:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5806b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8f8da797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.785801:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704142336:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 2623us (3230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050130.785811:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:1.0:1789050130.788860:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.789041:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142464 00000100:00100000:2.0:1789050130.789051:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142464 00000100:00100000:2.0:1789050130.789106:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 191 00000100:00100000:2.0:1789050130.789116:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+66:12393:x1875954704142464:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.789135:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050130.789155:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58072 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d2a expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789188:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789202:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789213:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789379:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df58072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 68 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789399:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 67 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.789414:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:2.0:1789050130.789417:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050130.789420:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694800, rc 0) 00000100:00100000:2.0:1789050130.789516:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+67:12393:x1875954704142464:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 400us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.789522:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 191 00000100:00100000:1.0:1789050130.798030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050130.798078:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142720 00000100:00100000:1.0:1789050130.798087:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142720 00000100:00100000:1.0:1789050130.798141:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00100000:1.0:1789050130.798153:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+67:12393:x1875954704142720:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050130.798241:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.798261:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.798286:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050130.798466:0:13807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789050130.798476:0:13807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352996537615ns, next at 353996534973ns, rc = 0 00000004:00010000:1.0:1789050130.798528:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000dbd24050 reply state 00000000703b7571 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.798541:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.798549:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:1.0:1789050130.798552:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789050130.798556:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050130.800109:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+69:12393:x1875954704142720:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 1951us (2082us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789050130.800120:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00100000:1.0:1789050130.813462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.813716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142848 00000100:00100000:3.0:1789050130.813726:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142848 00000100:00100000:3.0:1789050130.813774:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 193 00000100:00100000:3.0:1789050130.813784:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+69:12393:x1875954704142848:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.813809:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050130.813832:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.813904:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.813921:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.813955:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:3.0:1789050130.813959:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050130.813964:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050130.814024:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+70:12393:x1875954704142848:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 242us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.814031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 193 00000100:00100000:1.0:1789050130.817560:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.821454:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142976 00000100:00100000:3.0:1789050130.821467:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142976 00000100:00100000:3.0:1789050130.821590:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789050130.821602:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704142976:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789050130.821834:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704142976:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 234us (4281us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789050130.821855:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00080000:0.0:1789050130.821900:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050130.826393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.826534:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143232 00000100:00100000:3.0:1789050130.826547:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143232 00000100:00100000:3.0:1789050130.826620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789050130.826631:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+70:12393:x1875954704143232:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050130.826903:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+71:12393:x1875954704143232:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 273us (518us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789050130.826911:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789050130.831409:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050130.831933:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143488 00000100:00100000:0.0:1789050130.831956:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143488 00000100:00100000:0.0:1789050130.832012:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:0.0:1789050130.832023:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+71:12393:x1875954704143488:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789050130.832131:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+71:12393:x1875954704143488:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 111us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050130.832139:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:0.0:1789050130.840146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050130.841006:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143616 00000100:00100000:0.0:1789050130.841017:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143616 00000100:00100000:0.0:1789050130.841088:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 195 00000100:00100000:0.0:1789050130.841097:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+71:12393:x1875954704143616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050130.841115:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050130.841133:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5808e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d38 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841197:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841212:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841223:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050130.841337:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050130.841367:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841393:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5808e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d38 expref: 73 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841407:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d38 expref: 72 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.841415:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:0.0:1789050130.841418:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789050130.841421:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1000, rc 0) 00000100:00100000:0.0:1789050130.841480:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+72:12393:x1875954704143616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 383us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050130.841487:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 195 00000100:00100000:1.0:1789050130.848449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.848542:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143744 00000100:00100000:3.0:1789050130.848552:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143744 00000100:00100000:3.0:1789050130.848614:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:3.0:1789050130.848635:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704143744:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.848654:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050130.848676:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d3f expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050130.848702:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb9d44354d40, blocks: 0x0 00010000:00010000:3.0:1789050130.848722:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789050130.848727:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050130.848735:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.849047:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.849712:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:3.0:1789050130.849810:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704143744:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1186us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.849818:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789050130.853483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.854438:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144000 00000100:00100000:2.0:1789050130.854450:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144000 00000100:00100000:2.0:1789050130.854530:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:2.0:1789050130.854541:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+72:12393:x1875954704144000:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789050130.854655:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+72:12393:x1875954704144000:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 116us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.854664:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:0.0:1789050130.867133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.867215:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144128 00000100:00100000:3.0:1789050130.867225:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144128 00000100:00100000:3.0:1789050130.867294:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:3.0:1789050130.867306:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baabdf31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:12393:x1875954704144128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.867324:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050130.867341:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d46 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.867371:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.867380:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050130.867384:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050130.867389:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.867423:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.867446:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.867461:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714681216:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050130.867550:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050130.879574:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.879723:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1875954714681216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050130.879759:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050130.879777:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144256 00010000:00010000:3.0:1789050130.879781:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603600, rc 0) 00000100:00100000:1.0:1789050130.879787:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144256 00010000:00010000:1.0:1789050130.879825:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 10 pid: 8629 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.879853:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baabdf31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+10:12393:x1875954704144128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 12547us (12728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.879862:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:1.0:1789050130.879875:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:1.0:1789050130.879887:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704144256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050130.879901:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050130.879922:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.879934:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.879975:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000230bb4e8/0x3b8ec5973df5809c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d3f expref: 9 pid: 8629 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.879991:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050130.879995:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050130.880004:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.880014:0:6503:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.880065:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050130.880080:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1875954714681344:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789050130.880144:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789050130.894383:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1875954714681344:192.168.203.42@tcp:105: 00010000:00010000:2.0:1789050130.894412:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050130.894472:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704144256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 14587us (14907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.894484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:0.0:1789050130.896513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.896990:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144384 00000100:00100000:2.0:1789050130.897001:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144384 00002000:00100000:2.0:1789050130.897054:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ba983eab800 x1875954704144384/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:631/0 lens 504/0 e 0 to 0 dl 1789050141 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050130.897065:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983eab800 with x1875954704144384 ext(0->8) 00002000:00010000:2.0:1789050130.897071:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983eab800 00000100:00100000:2.0:1789050130.897112:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:2.0:1789050130.897122:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704144384:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789050130.898752:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+10:2404:x1875954704144384:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 1626us (2241us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789050130.898763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00002000:00100000:2.0:1789050130.898774:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ba983eab800 x1875954704144384/t4294967315(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:631/0 lens 504/448 e 0 to 0 dl 1789050141 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050130.898783:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983eab800 with x1875954704144384 ext(0->8) 00002000:00010000:2.0:1789050130.898789:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983eab800 00000100:00100000:0.0:1789050130.901694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050130.901786:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144512 00000100:00100000:1.0:1789050130.901795:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144512 00000100:00100000:1.0:1789050130.901861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 197 00000100:00100000:1.0:1789050130.901872:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+72:12393:x1875954704144512:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789050130.907268:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000004:00080000:2.0:1789050130.907286:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789050130.907304:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789050130.907355:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789050130.907366:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baa87571000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789050130.907371:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba983468a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baa87571f00 00000020:00080000:2.0:1789050130.907374:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba983468f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba98346b400 00010000:00010000:2.0:1789050130.907418:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907429:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907438:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907444:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907449:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907466:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907483:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baaae575c00) 00010000:00010000:2.0:1789050130.907487:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907493:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907500:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df57dcb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907518:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907525:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907531:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907536:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907539:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907545:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907552:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050130.907554:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907557:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907569:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df57dd2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907586:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907592:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907598:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907602:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907605:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907611:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907619:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae575000) 00010000:00010000:2.0:1789050130.907622:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907625:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907631:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df57e11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907656:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907661:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907674:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907679:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907682:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907688:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907696:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.907699:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907702:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907708:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6e00/0x3b8ec5973df57f14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907721:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907727:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907733:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907738:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907750:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907767:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907775:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.907777:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907780:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907785:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df57f37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907798:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907804:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907810:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907815:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907818:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907823:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907830:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.907833:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050130.907836:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907867:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df57f7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907881:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907888:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907894:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907899:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050130.907902:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907909:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907917:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:2.0:1789050130.907920:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050130.907923:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.907929:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58080 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789050130.908077:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789050130.908133:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789050130.908153:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714681472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789050130.908230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050130.908276:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050130.908282:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714681600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789050130.908305:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050130.908335:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714681472 00000100:00100000:2.0:1789050130.908342:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714681472 00000100:00100000:2.0:1789050130.908389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714681600 00000100:00100000:2.0:1789050130.908392:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714681600 00000100:00100000:2.0:1789050130.908414:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050130.908423:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714681472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789050130.908520:0:8434:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789050130.908523:0:8434:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789050129970554520 00002000:00010000:2.0:1789050130.908526:0:8434:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789050130.908527:0:8434:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789050129869000000 -> 1789050129970554520 00002000:00010000:2.0:1789050130.908530:0:8434:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789050130.908568:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714681472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (338us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789050130.908576:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050130.908592:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789050130.908598:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714681600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789050130.908617:0:8434:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1789050130.908640:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb9c9ddaac94, atime: 0x18d3fb9caa103158, ctime: 0x18d3fb9c9ddaac94, blocks: 0x8 00010000:00010000:2.0:1789050130.908647:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.908661:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789050130.908666:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050130.908679:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.908695:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.908706:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.908713:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.908730:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789050130.908865:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714681600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 266us (557us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789050130.908871:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789050130.908893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789050130.908929:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983df8380/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789050130.908953:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714681600:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789050130.908966:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983dfbb80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789050130.908969:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714681472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789050130.909379:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:12393:x1875954704144512:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 7506us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050130.909388:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 197 00010000:00010000:1.0:1789050130.909422:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050130.909428:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.909439:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050130.909443:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.909453:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.909469:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.909482:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079fa1162/0x3b8ec5973df580aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.909499:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050130.909501:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050130.909503:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050130.912380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050130.912811:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144640 00000100:00100000:1.0:1789050130.912821:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144640 00000100:00100000:1.0:1789050130.912893:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:1.0:1789050130.912902:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+10:2404:x1875954704144640:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789050130.917895:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789050130.917909:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1789050130.924221:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704144640:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 11310us (11841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.924236:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:0.0:1789050130.929476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.929567:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144896 00000100:00100000:2.0:1789050130.929577:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144896 00000100:00100000:2.0:1789050130.929655:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 198 00000100:00100000:2.0:1789050130.929667:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+19:12393:x1875954704144896:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.929738:0:13807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050130.929767:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58095 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d38 expref: 19 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.929788:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:2.0:1789050130.929793:0:13807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050130.929825:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.929853:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.929864:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050130.930332:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000dc894d0e reply state 0000000063927800 transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.930348:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.930355:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:2.0:1789050130.930357:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050130.930360:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050130.930494:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+20:12393:x1875954704144896:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 828us (1026us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789050130.930502:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 198 00000100:00100000:1.0:1789050130.945617:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050130.945659:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145024 00000100:00100000:1.0:1789050130.945669:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145024 00000100:00100000:1.0:1789050130.945720:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789050130.945730:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704145024:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789050130.945898:0:8432:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789050130.945902:0:8432:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789050129970554520 -> 1789050128804000000 00002000:00010000:1.0:1789050130.945904:0:8432:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789050127280000000 00002000:00010000:1.0:1789050130.945907:0:8432:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789050129970554520 -> 1789050128804000000 00002000:00010000:1.0:1789050130.945910:0:8432:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789050130.946056:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704145024:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 326us (447us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789050130.946065:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:0.0:1789050130.952030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.952163:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145280 00000100:00100000:3.0:1789050130.952174:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145280 00000100:00100000:3.0:1789050130.952238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:3.0:1789050130.952249:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+20:12393:x1875954704145280:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.952326:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.952343:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 20 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.952362:0:6520:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.952398:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 20 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.952413:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 20 pid: 10357 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.952430:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714681728:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050130.952515:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050130.957959:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.958071:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714681728:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050130.958099:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.958128:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145408 00000100:00100000:3.0:1789050130.958134:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145408 00010000:00010000:3.0:1789050130.958166:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 21 pid: 10357 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.958197:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:3.0:1789050130.958205:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:2403:x1875954704145408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050130.958219:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050130.958226:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 21 pid: 10357 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.958254:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 21 pid: 10357 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959068:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d2a expref: 21 pid: 10357 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959089:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:3.0:1789050130.959094:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959104:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959112:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959138:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050130.959193:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+20:2403:x1875954704145408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 987us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.959201:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 87 00010000:00010000:3.0:1789050130.959241:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959248:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959525:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959545:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959553:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959559:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050130.959563:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959571:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959581:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:3.0:1789050130.959584:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789050130.959588:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.959594:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.959634:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+19:12393:x1875954704145280:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 7387us (7614us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789050130.959642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:3.0:1789050130.963989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.969087:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145536 00000100:00100000:3.0:1789050130.969102:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145536 00000100:00100000:3.0:1789050130.969200:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:3.0:1789050130.969212:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+8:2405:x1875954704145536:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789050130.969276:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.969298:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.969306:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050130.969310:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050130.969315:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.969353:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.969369:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.969386:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1875954714681856:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050130.969476:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d0c0 going to sleep for 11 seconds 00000040:00080000:3.0:1789050130.972630:0:14656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050130.972640:0:14656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050130.972678:0:14656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789050130.972685:0:14656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050130.977740:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050130.978378:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145664 00000100:00100000:1.0:1789050130.978389:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145664 00010000:00010000:1.0:1789050130.978427:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 9 pid: 8432 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050130.978469:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:1.0:1789050130.978479:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704145664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050130.978495:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050130.978518:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 9 pid: 8432 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.978533:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 9 pid: 8432 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.978557:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050130.978561:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050130.978568:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.978578:0:7461:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.978600:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050130.978651:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704145664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 173us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050130.978658:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 88 00010000:00010000:3.0:1789050130.979360:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b25450c6/0x3b8ec5973df580a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d46 expref: 8 pid: 8432 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.979386:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1875954714681856:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050130.979406:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979417:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979425:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979447:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979456:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979464:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979471:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050130.979475:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979484:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979504:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.979511:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df580bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.979563:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704145536:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 10354us (15583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050130.979571:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:3.0:1789050130.982097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.982243:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145920 00000100:00100000:2.0:1789050130.982253:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145920 00000100:00100000:2.0:1789050130.982353:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:2.0:1789050130.982363:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+19:12393:x1875954704145920:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050130.982438:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.982455:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.982466:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.982501:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.982516:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 19 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.982531:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714681984:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050130.982605:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba981a5f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050130.985636:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050130.985695:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714681984:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050130.985723:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.985850:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146048 00000100:00100000:2.0:1789050130.985858:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146048 00010000:00010000:2.0:1789050130.985894:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 20 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.985958:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:2.0:1789050130.985977:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+20:2403:x1875954704146048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050130.986005:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050130.986012:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 20 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986024:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 20 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986046:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df57f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ccf expref: 20 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986059:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050130.986064:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986074:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986083:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.986104:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050130.986152:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:2403:x1875954704146048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 185us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.986160:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00010000:00010000:3.0:1789050130.987316:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987328:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987504:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987518:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987538:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987571:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.987586:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 19 pid: 6520 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050130.987600:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714682112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050130.987679:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050130.993114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050130.993222:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714682112:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050130.993252:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050130.994084:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146176 00000100:00100000:0.0:1789050130.994094:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146176 00010000:00010000:0.0:1789050130.994135:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 20 pid: 6520 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050130.994164:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789050130.994172:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+20:2404:x1875954704146176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050130.994195:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050130.994202:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 20 pid: 6520 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994214:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 20 pid: 6520 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994234:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d31 expref: 20 pid: 6520 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994248:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:0.0:1789050130.994253:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994263:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994270:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.994338:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050130.994406:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+19:2404:x1875954704146176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 234us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050130.994413:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00010000:00010000:3.0:1789050130.996171:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050130.996185:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050130.996354:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00000001:00080000:3.0:1789050130.996458:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000001:00080000:3.0:1789050130.996489:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967472 00000100:00100000:3.0:1789050130.996577:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714682240:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050130.996674:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050130.996744:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050130.996854:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714682240 00000100:00100000:2.0:1789050130.996867:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714682240 00000100:00100000:2.0:1789050130.996973:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789050130.996982:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714682240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050130.997057:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714682240:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050130.997064:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789050130.997129:0:10357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789050130.997135:0:10357:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983dfbb80, transno 4294967316 00000100:00100000:1.0:1789050130.997151:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714682240:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789050130.997248:0:10357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000100:00100000:1.0:1789050130.997296:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714682368:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789050130.997323:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050130.999788:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050131.002413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714682368 00000100:00100000:3.0:1789050131.002427:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714682368 00000100:00100000:3.0:1789050131.002484:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789050131.002493:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10357:x1875954714682368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050131.002708:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10357:x1875954714682368:12345-0@lo:1000:mdt00_003.0 Request processed in 216us (5383us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789050131.002717:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789050131.002784:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10357:1875954714682368:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789050131.002834:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002856:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002863:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002869:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050131.002874:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002881:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002895:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:3.0:1789050131.002898:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050131.002903:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002908:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df580cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002955:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002976:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002982:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002987:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050131.002990:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.002995:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003003:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:3.0:1789050131.003005:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050131.003008:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003013:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58002 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003034:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003047:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 22 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003056:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003086:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 22 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050131.003106:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 22 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050131.003121:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714682496:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050131.003190:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050131.010827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050131.010896:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714682496:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050131.010924:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050131.013784:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146304 00000100:00100000:2.0:1789050131.013797:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146304 00010000:00010000:2.0:1789050131.013870:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 23 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050131.013917:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:2.0:1789050131.013930:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+23:2403:x1875954704146304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050131.014032:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050131.014043:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 23 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014150:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 23 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014175:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5801e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d15 expref: 23 pid: 14070 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014192:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:2.0:1789050131.014197:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014377:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014393:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.014428:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050131.014492:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+22:2403:x1875954704146304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 564us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.014500:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00080000:2.0:1789050131.014522:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789050131.014603:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014613:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014640:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014647:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014654:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014661:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050131.014664:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014671:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014681:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050131.014684:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050131.014688:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014695:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df580d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014706:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014711:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014716:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014726:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050131.014729:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014735:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014743:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ba9832fd800) 00010000:00010000:0.0:1789050131.014745:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050131.014748:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.014754:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df580c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050131.014902:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+21:12393:x1875954704145920:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 32539us (32977us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789050131.014910:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 200 00000020:00080000:0.0:1789050131.014914:0:10357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789050131.015019:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050131.015023:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050131.015430:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1789050131.015437:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050131.022391:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050131.022509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146560 00000100:00100000:0.0:1789050131.022519:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146560 00000100:00100000:0.0:1789050131.022579:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789050131.022590:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:12393:x1875954704146560:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050131.022861:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789050131.022908:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00010000:00010000:0.0:1789050131.023293:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023311:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023323:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023333:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023341:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023348:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023369:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050131.023450:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+23:12393:x1875954704146560:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 862us (1067us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789050131.023459:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000020:00080000:0.0:1789050131.023464:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789050131.023508:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050131.023513:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023520:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050131.023525:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023544:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023556:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:0.0:1789050131.023559:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789050131.023564:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023570:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df580db lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050131.023596:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050131.023598:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050131.023600:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050131.050763:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714682624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050131.050859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050131.050894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714682880:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.050931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714683136:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.050955:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.050997:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714682752:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.051028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.051063:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714683392:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.051065:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714683264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050131.051100:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050131.051107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.051124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714683776:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.051135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714683904:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.051154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050131.051170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.051199:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683776 00000100:00100000:3.0:1789050131.051200:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789050131.051208:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683776 00000100:00100000:3.0:1789050131.051209:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714683008:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.051242:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.051259:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789050131.051265:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714683520:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.051271:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714683776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.051319:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714683776:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.051326:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789050131.051370:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714683776:0@lo:400:kworker.0 00000100:00100000:1.0:1789050131.051829:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714682624 00000100:00100000:1.0:1789050131.051835:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714682624 00000100:00100000:1.0:1789050131.051885:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683264 00000100:00100000:1.0:1789050131.051889:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683264 00000100:00100000:1.0:1789050131.051907:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789050131.051915:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714682624:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789050131.051919:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789050131.051934:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789050131.052003:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714682624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.052010:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789050131.052023:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789050131.052030:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714683264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050131.052040:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789050131.052079:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714683264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050131.052084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050131.052103:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789050131.052106:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714684032:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.052129:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050131.052161:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714683264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050131.052189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714682880 00000100:00100000:3.0:1789050131.052192:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714682880 00000100:00100000:3.0:1789050131.052227:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683904 00000100:00100000:3.0:1789050131.052237:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683904 00000100:00100000:2.0:1789050131.052341:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714684032 00000100:00100000:2.0:1789050131.052346:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714684032 00000100:00100000:2.0:1789050131.052370:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789050131.052379:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050131.052388:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789050131.052400:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714683904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.052424:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714682880:12345-0@lo:400:kworker.0 Request processed in 46us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.052432:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789050131.052449:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9837caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714683904:12345-0@lo:400:kworker.0 Request processed in 52us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.052457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789050131.052468:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789050131.052477:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714684032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.052505:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714684032:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.052512:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789050131.053044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683520 00000100:00100000:3.0:1789050131.053051:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683520 00000100:00100000:3.0:1789050131.053124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789050131.053132:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.053171:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714683520:12345-0@lo:400:kworker.0 Request processed in 41us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050131.053177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1789050131.053203:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050131.053207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050131.053228:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714683520:0@lo:400:kworker.0 00010000:00080000:3.0:1789050131.053241:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c8aa00 x1875954714684032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050131.053252:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714684032:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.053263:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714682880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.053663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714683904:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.055156:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683392 00000100:00100000:2.0:1789050131.055174:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683392 00000100:00100000:2.0:1789050131.055220:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683008 00000100:00100000:2.0:1789050131.055224:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683008 00000100:00100000:1.0:1789050131.055239:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789050131.055244:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789050131.055249:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714683008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050131.055249:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714683392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.055438:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714683008:12345-0@lo:400:kworker.0 Request processed in 186us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.055446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789050131.055471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714682752 00000100:00100000:2.0:1789050131.055475:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714682752 00000100:00100000:2.0:1789050131.055503:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789050131.055506:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714683008:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.055514:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714682752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.055566:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa857a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714682752:12345-0@lo:400:kworker.0 Request processed in 56us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.055580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789050131.055637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714682752:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.056580:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050131.056821:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683136 00000100:00100000:3.0:1789050131.056828:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683136 00000100:00100000:3.0:1789050131.056875:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789050131.056884:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714683136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.056961:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714683136:12345-0@lo:400:kworker.0 Request processed in 78us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050131.056984:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789050131.057031:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714683136:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.057045:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714683648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.057075:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.057102:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714684160:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.057126:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050131.057158:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714682624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050131.057202:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714684160 00000100:00100000:2.0:1789050131.057206:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714684160 00000100:00100000:2.0:1789050131.057232:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789050131.057239:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714684160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.057256:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714683648 00000100:00100000:3.0:1789050131.057262:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714683648 00000100:00100000:2.0:1789050131.057278:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714684160:12345-0@lo:400:kworker.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.057285:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789050131.057307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789050131.057314:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714683648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050131.057345:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714683648:12345-0@lo:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050131.057351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:3.0:1789050131.057373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789050131.057453:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570b100 x1875954714683648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050131.057463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714683648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050131.057473:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714684160:0@lo:400:kworker.0 00000100:00100000:1.0:1789050131.058453:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714683392:12345-0@lo:400:kworker.0 Request processed in 3201us (7348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.058463:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789050131.058565:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714683392:0@lo:400:kworker.0 00010000:00010000:2.0:1789050131.625480:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050131.913657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913700:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913815:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050131.913902:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147200 00000100:00100000:2.0:1789050131.913923:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147200 00000100:00100000:2.0:1789050131.914011:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147072 00000100:00100000:2.0:1789050131.914015:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147072 00000100:00100000:2.0:1789050131.914046:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:2.0:1789050131.914055:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704147200:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050131.914121:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704147200:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 67us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.914128:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:2.0:1789050131.914145:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:2.0:1789050131.914151:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704147072:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050131.914175:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704147072:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050131.914181:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:1.0:1789050131.915332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146944 00000100:00100000:1.0:1789050131.915344:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146944 00000100:00100000:1.0:1789050131.915409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147456 00000100:00100000:1.0:1789050131.915412:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147456 00000100:00100000:1.0:1789050131.915431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146816 00000100:00100000:1.0:1789050131.915435:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146816 00000100:00100000:1.0:1789050131.915447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147328 00000100:00100000:1.0:1789050131.915449:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147328 00000100:00100000:1.0:1789050131.915468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 317 00000100:00100000:1.0:1789050131.915478:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704146944:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050131.915534:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2405:x1875954704146944:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 58us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.915540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 317 00000100:00100000:1.0:1789050131.915557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 318 00000100:00100000:1.0:1789050131.915562:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704147456:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050131.915604:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704147456:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.915610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 318 00000100:00100000:1.0:1789050131.915622:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 319 00000100:00100000:1.0:1789050131.915628:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:2405:x1875954704146816:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050131.915657:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:2405:x1875954704146816:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.915663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 319 00000100:00100000:1.0:1789050131.915677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 320 00000100:00100000:1.0:1789050131.915682:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704147328:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050131.915705:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2405:x1875954704147328:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050131.915710:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 320 00000100:00100000:3.0:1789050131.915963:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146688 00000100:00100000:3.0:1789050131.915977:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146688 00000100:00100000:3.0:1789050131.916026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 384 00000100:00100000:3.0:1789050131.916034:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704146688:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050131.916064:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704146688:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 32us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050131.916071:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 384 00000100:00080000:3.0:1789050131.916126:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050131.916131:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050131.916134:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789050132.073499:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050132.073510:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050132.073614:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789050132.073623:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789050132.076887:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789050132.650475:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050132.944772:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050132.944783:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050132.944806:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789050132.944812:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050133.063921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.064012:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147712 00000100:00100000:1.0:1789050133.064022:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147712 00000100:00100000:1.0:1789050133.064088:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00100000:1.0:1789050133.064098:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+23:12411:x1875954704147712:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050133.064125:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050133.064184:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df580e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d4d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.064305:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570200/0x3b8ec5973df580e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.064321:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570200/0x3b8ec5973df580e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.064334:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570200/0x3b8ec5973df580e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050133.064345:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789050133.064450:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df580e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d4d expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.064466:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570200/0x3b8ec5973df580e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d4d expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.064475:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:1.0:1789050133.064478:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789050133.064481:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570200, rc 0) 00000100:00100000:1.0:1789050133.064535:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+25:12411:x1875954704147712:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 439us (625us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789050133.064541:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00080000:3.0:1789050133.064880:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050133.074013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.074147:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147840 00000100:00100000:0.0:1789050133.074157:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147840 00000100:00100000:0.0:1789050133.074211:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:0.0:1789050133.074221:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+25:12411:x1875954704147840:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:0.0:1789050133.074305:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074323:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074335:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074349:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074374:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074382:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074453:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074462:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074469:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050133.074516:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074529:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074536:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074543:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074550:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.074554:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074562:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074578:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050133.074581:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.074586:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074593:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df580f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074604:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074610:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074616:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074620:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.074623:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074628:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074635:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.074638:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.074640:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074646:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df580fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074668:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074675:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074682:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074686:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.074689:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074695:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074702:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590e00) 00010000:00010000:0.0:1789050133.074705:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.074708:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.074713:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.074793:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+25:12411:x1875954704147840:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 573us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.074800:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:3.0:1789050133.134434:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.134620:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148096 00000100:00100000:0.0:1789050133.134630:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148096 00000100:00100000:0.0:1789050133.134696:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 203 00000100:00100000:0.0:1789050133.134722:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+25:12414:x1875954704148096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050133.134743:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.134764:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5810c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d54 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134844:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134859:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134870:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134883:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134890:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.134897:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135044:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135053:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135060:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050133.135081:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789050133.135157:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135166:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135172:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135177:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.135181:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135188:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135198:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050133.135201:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.135206:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135211:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df58113 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135222:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135227:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135241:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135246:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.135249:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135254:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135262:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae590e00) 00010000:00010000:0.0:1789050133.135265:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.135267:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135273:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5811a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135312:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5810c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 28 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135325:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 27 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.135331:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.135333:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050133.135336:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1800, rc 0) 00000100:00100000:0.0:1789050133.135404:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+27:12414:x1875954704148096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 684us (979us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789050133.135420:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 203 00000100:00100000:0.0:1789050133.140329:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.140416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148224 00000100:00100000:1.0:1789050133.140427:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148224 00000100:00100000:1.0:1789050133.140536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 204 00000100:00100000:1.0:1789050133.140547:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+27:12414:x1875954704148224:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789050133.140622:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140641:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140654:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140692:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140700:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140707:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140713:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050133.140717:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140725:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140735:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:1.0:1789050133.140739:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050133.140744:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.140763:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570a00/0x3b8ec5973df5812f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.140854:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+27:12414:x1875954704148224:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 309us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050133.140862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 204 00000100:00100000:1.0:1789050133.144433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.144658:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148480 00000100:00100000:0.0:1789050133.144669:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148480 00000100:00100000:0.0:1789050133.144725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789050133.144734:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+27:12414:x1875954704148480:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050133.144995:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+28:12414:x1875954704148480:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 262us (571us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789050133.145003:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:3.0:1789050133.188469:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.188633:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148736 00000100:00100000:0.0:1789050133.188643:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148736 00000100:00100000:0.0:1789050133.188702:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 205 00000100:00100000:0.0:1789050133.188713:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+28:11937:x1875954704148736:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050133.188735:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.188765:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58136 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d5b expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.188881:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.188896:0:14070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 29 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.188906:0:14070:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.188968:0:14070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 29 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.188996:0:14070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 29 pid: 10357 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.189010:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714684288:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050133.189103:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050133.199743:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.199883:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714684288:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050133.199911:0:14070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050133.202633:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148864 00000100:00100000:3.0:1789050133.202647:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148864 00010000:00010000:3.0:1789050133.202697:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 30 pid: 10357 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050133.202837:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:3.0:1789050133.202849:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+30:2403:x1875954704148864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050133.202866:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050133.202874:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 30 pid: 10357 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.202885:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 30 pid: 10357 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.202905:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d54 expref: 30 pid: 10357 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.202921:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:3.0:1789050133.202926:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.202934:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.202978:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.203012:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050133.203070:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+29:2403:x1875954704148864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 223us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050133.203078:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 92 00010000:00010000:2.0:1789050133.203145:0:14070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.203153:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050133.203174:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789050133.203304:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58136 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 30 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.203335:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 29 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.203343:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:2.0:1789050133.203346:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050133.203348:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0200, rc 0) 00000100:00100000:2.0:1789050133.203377:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+29:11937:x1875954704148736:12345-192.168.203.42@tcp:101:bash.0 Request processed in 14667us (14929us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789050133.203384:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 205 00000100:00100000:1.0:1789050133.216345:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.216427:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148992 00000100:00100000:0.0:1789050133.216436:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148992 00000100:00100000:0.0:1789050133.216509:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00100000:0.0:1789050133.216519:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+29:11937:x1875954704148992:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050133.216539:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.216558:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df5814b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d62 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216588:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df58152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216602:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df58152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216612:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df58152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216732:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0000/0x3b8ec5973df5814b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d62 expref: 31 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216757:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df58152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d62 expref: 30 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.216766:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.216769:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050133.216773:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0800, rc 0) 00000100:00100000:0.0:1789050133.216847:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+30:11937:x1875954704148992:12345-192.168.203.42@tcp:101:bash.0 Request processed in 329us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.216854:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00100000:2.0:1789050133.220343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.220410:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149248 00000100:00100000:0.0:1789050133.220421:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149248 00000100:00100000:0.0:1789050133.220584:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 207 00000100:00100000:0.0:1789050133.220595:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+30:11937:x1875954704149248:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:0.0:1789050133.220797:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.220815:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.220837:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050133.220877:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967481 00000004:00010000:0.0:1789050133.220896:0:6519:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000003f8c037 reply state 0000000009888ae5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.220908:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.220930:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.220932:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050133.220977:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789050133.221014:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967482 00000100:00100000:0.0:1789050133.221100:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+34:11937:x1875954704149248:12345-192.168.203.42@tcp:36:bash.0 Request processed in 507us (765us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789050133.221107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 207 00000020:00080000:0.0:1789050133.221112:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789050133.228342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050133.228549:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149376 00000100:00100000:3.0:1789050133.228574:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149376 00000100:00100000:3.0:1789050133.228634:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 208 00000100:00100000:3.0:1789050133.228644:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+34:11937:x1875954704149376:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050133.228669:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050133.228689:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df58160 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d69 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.228743:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df58160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d69 expref: 35 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.228932:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df58160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d69 expref: 35 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.229049:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:3.0:1789050133.229053:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050133.229058:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050133.229163:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+35:11937:x1875954704149376:12345-192.168.203.42@tcp:101:bash.0 Request processed in 520us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050133.229172:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 208 00000100:00100000:2.0:1789050133.232886:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.233569:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149504 00000100:00100000:0.0:1789050133.233591:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149504 00000100:00100000:0.0:1789050133.233671:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789050133.233682:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:11937:x1875954704149504:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050133.233700:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.233722:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d70 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789050133.233740:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789050133.233749:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb9d04bab100, atime: 0x18d3fb9ca9e44c00, ctime: 0x18d3fb9d04bab100, blocks: 0x8 00010000:00010000:0.0:1789050133.233772:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789050133.233777:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050133.233785:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.233816:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.233835:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0000, rc 0) 00000100:00100000:0.0:1789050133.233917:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:11937:x1875954704149504:12345-192.168.203.42@tcp:101:bash.0 Request processed in 237us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.233924:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:2.0:1789050133.241183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.241289:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149632 00000100:00100000:1.0:1789050133.241300:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149632 00002000:00010000:1.0:1789050133.241341:0:8440:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789050133.241346:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba98369d180 with x1875954704149632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789050133.241358:0:8440:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba98369d180. 00000100:00100000:1.0:1789050133.241421:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789050133.241431:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704149632:12345-192.168.203.42@tcp:10:bash.0 00002000:00010000:1.0:1789050133.241814:0:8440:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789050133.241818:0:8440:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789050128804000000 -> 1789050132296000000 00002000:00010000:1.0:1789050133.241829:0:8440:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789050127280000000 -> 1789050127280000000 00002000:00010000:1.0:1789050133.241831:0:8440:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789050128804000000 -> 1789050132296000000 00002000:00010000:1.0:1789050133.241833:0:8440:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789050133.241898:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704149632:12345-192.168.203.42@tcp:10:bash.0 Request processed in 466us (724us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789050133.241905:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00002000:00010000:1.0:1789050133.241909:0:8440:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789050133.241923:0:8440:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba98369d180 with x1875954704149632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789050133.241929:0:8440:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba98369d180. 00000100:00100000:1.0:1789050133.360122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.361712:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149760 00000100:00100000:0.0:1789050133.361726:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149760 00000100:00100000:0.0:1789050133.361874:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:0.0:1789050133.361887:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+35:12428:x1875954704149760:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:0.0:1789050133.362003:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362019:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362031:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362045:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362053:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362059:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362140:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362149:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362156:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050133.362221:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362233:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362239:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362245:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362250:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.362255:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362262:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362274:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050133.362277:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.362282:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362288:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df5816e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362301:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362306:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362318:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362323:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.362326:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362333:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362341:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baaae590500) 00010000:00010000:0.0:1789050133.362344:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.362346:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362352:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df58175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362366:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362372:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362376:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362380:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.362383:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362397:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362404:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.362406:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.362409:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.362414:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df5817c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.362809:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+35:12428:x1875954704149760:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 923us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.363131:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:2.0:1789050133.434753:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.434863:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150016 00000100:00100000:1.0:1789050133.434873:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150016 00000100:00100000:1.0:1789050133.435005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:1.0:1789050133.435016:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+35:12431:x1875954704150016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050133.435039:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050133.435061:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58183 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d77 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435181:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435197:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435208:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435234:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435242:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435248:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435494:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58198 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435511:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435519:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050133.435530:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789050133.435615:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435622:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435628:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435633:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050133.435637:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435645:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435656:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:1.0:1789050133.435659:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050133.435663:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435669:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df5818a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435681:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435692:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435697:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435702:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050133.435705:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435710:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435717:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ba9832fdc00) 00010000:00010000:1.0:1789050133.435720:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050133.435723:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435729:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435769:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58183 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d77 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435782:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d77 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.435788:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:1.0:1789050133.435790:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789050133.435798:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570c00, rc 0) 00000100:00100000:1.0:1789050133.435874:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+37:12431:x1875954704150016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 858us (1129us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789050133.435882:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:2.0:1789050133.440613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.440718:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150144 00000100:00100000:0.0:1789050133.440728:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150144 00000100:00100000:0.0:1789050133.440794:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:0.0:1789050133.440804:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+37:12431:x1875954704150144:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789050133.440881:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.440899:0:14070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 37 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.440908:0:14070:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.447166:0:14070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 37 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.447201:0:14070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 37 pid: 14070 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.447221:0:14070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714684416:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050133.447486:0:14070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050133.454417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.454549:0:14070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14070:1875954714684416:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050133.454580:0:14070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050133.457909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150400 00000100:00100000:3.0:1789050133.457967:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150400 00000100:00100000:3.0:1789050133.458105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:3.0:1789050133.458117:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+38:6174:x1875954704150400:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1789050133.458337:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:3.0:1789050133.458457:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+40:6174:x1875954704150400:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 342us (4049us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789050133.458485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000020:00080000:3.0:1789050133.458490:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050133.464838:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.466147:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150528 00000100:00100000:0.0:1789050133.466247:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150528 00010000:00010000:0.0:1789050133.466488:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 40 pid: 14070 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.466713:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:0.0:1789050133.466725:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+40:2403:x1875954704150528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050133.466743:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050133.466751:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 40 pid: 14070 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466765:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 40 pid: 14070 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466787:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df5813d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d5b expref: 40 pid: 14070 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466804:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:0.0:1789050133.466810:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466829:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466838:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.466874:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050133.467002:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+39:2403:x1875954704150528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 278us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.467010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 93 00010000:00010000:1.0:1789050133.468004:0:14070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468017:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468059:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468066:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468072:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468087:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050133.468091:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468098:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468110:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:1.0:1789050133.468113:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050133.468116:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.468121:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df581a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.468197:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+38:12431:x1875954704150144:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 27392us (27592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050133.468206:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:2.0:1789050133.472503:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.472574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150784 00000100:00100000:0.0:1789050133.472584:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150784 00000100:00100000:0.0:1789050133.472639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:0.0:1789050133.472648:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+38:12431:x1875954704150784:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789050133.472864:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+39:12431:x1875954704150784:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 217us (371us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789050133.472872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:3.0:1789050133.589349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050133.589421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151040 00000100:00100000:2.0:1789050133.589431:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151040 00000100:00100000:2.0:1789050133.589542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:2.0:1789050133.589552:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+39:12442:x1875954704151040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789050133.589577:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050133.589597:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d7e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589669:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589700:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589731:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589748:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589756:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589763:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589887:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df581c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589897:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df581c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.589905:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df581c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050133.589914:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789050133.590050:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590059:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590065:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590077:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050133.590081:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590088:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590101:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050133.590104:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050133.590108:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590114:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590127:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590132:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590137:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590142:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050133.590144:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590150:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590179:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b600) 00010000:00010000:2.0:1789050133.590181:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050133.590185:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590191:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590230:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d7e expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590242:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df581c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d7e expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.590250:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:2.0:1789050133.590252:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050133.590254:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695400, rc 0) 00000100:00100000:2.0:1789050133.590307:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+41:12442:x1875954704151040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 757us (966us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789050133.590314:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:2.0:1789050133.597464:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.597570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151296 00000100:00100000:0.0:1789050133.597581:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151296 00000100:00100000:0.0:1789050133.597641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789050133.597652:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+41:12442:x1875954704151296:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1789050133.597989:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+42:12442:x1875954704151296:12345-192.168.203.42@tcp:35:cat.0 Request processed in 338us (532us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1789050133.597997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:3.0:1789050133.610089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714684544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050133.610192:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050133.610268:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714684544 00000100:00100000:3.0:1789050133.610275:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714684544 00000100:00100000:3.0:1789050133.610320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789050133.610328:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714684544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050133.610358:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789050133.610401:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714684544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050133.610408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789050133.610455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714684544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050133.617186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050133.617987:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151552 00000100:00100000:2.0:1789050133.617997:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151552 00000100:00100000:2.0:1789050133.618052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 213 00000100:00100000:2.0:1789050133.618062:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+42:12443:x1875954704151552:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:2.0:1789050133.618112:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789050133.618138:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df58160 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d69 expref: 42 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618170:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695400/0x3b8ec5973df581c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d7e expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618184:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58198 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d77 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618196:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df58152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d62 expref: 39 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618207:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:2.0:1789050133.618212:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050133.618231:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618245:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618325:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618340:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618348:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618354:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618436:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618445:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618452:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050133.618660:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789050133.618671:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355816733255ns, next at 356816730611ns, rc = 0 00010000:00010000:2.0:1789050133.618717:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618727:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618734:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618742:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618748:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618754:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618767:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050133.618784:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618796:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618803:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.618809:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050133.618813:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619466:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050133.619474:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619482:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050133.619486:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619495:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619519:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:1.0:1789050133.619522:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050133.619527:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619533:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df581e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.619546:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050133.619548:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050133.619550:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050133.619778:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619789:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:2.0:1789050133.619792:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789050133.619795:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619801:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694a00/0x3b8ec5973df581de lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619817:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619834:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619839:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619844:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050133.619853:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619859:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619867:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050133.619869:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050133.619872:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619877:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df581d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050133.619888:0:6518:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f79162e1 reply state 0000000059ea3d56 transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619898:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.619905:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:2.0:1789050133.619907:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050133.619910:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050133.620283:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+40:12443:x1875954704151552:12345-192.168.203.42@tcp:36:rm.0 Request processed in 2218us (3100us total) trans 4294967490 rc 0/0 00000100:00100000:2.0:1789050133.620293:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 213 00000001:00080000:0.0:1789050133.623606:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789050133.623623:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00010000:00010000:2.0:1789050133.674438:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050133.679215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.679374:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151808 00000100:00100000:0.0:1789050133.679384:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151808 00000100:00100000:0.0:1789050133.679451:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:0.0:1789050133.679462:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+40:12449:x1875954704151808:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050133.679486:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.679508:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df581ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d85 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679611:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679645:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679657:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679669:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679682:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.679688:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050133.681543:0:13807:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789050133.682802:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682829:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682840:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682876:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682883:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682889:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.682920:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.682924:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683730:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683744:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050133.683747:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050133.683752:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683758:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1c00/0x3b8ec5973df581f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050133.683774:0:13807:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d0e7d49a reply state 000000009d330adf transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683785:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683791:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:0.0:1789050133.683794:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050133.683797:0:13807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789050133.683845:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0200/0x3b8ec5973df581ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 43 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683860:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 42 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.683883:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:0.0:1789050133.683886:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050133.683888:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1000, rc 0) 00000100:00100000:0.0:1789050133.684009:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+43:12449:x1875954704151808:12345-192.168.203.42@tcp:101:bash.0 Request processed in 4549us (4804us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1789050133.684019:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:3.0:1789050133.692274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.696196:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151936 00000100:00100000:0.0:1789050133.696213:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151936 00000100:00100000:1.0:1789050133.700531:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:1.0:1789050133.700546:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2404:x1875954704151936:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789050133.700565:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050133.700588:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d8c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050133.700614:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050133.700645:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1789050133.700650:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050133.700659:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.700679:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.700692:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571800, rc 0) 00000100:00100000:1.0:1789050133.700774:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704151936:12345-192.168.203.42@tcp:101:bash.0 Request processed in 231us (8510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050133.700782:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00080000:3.0:1789050133.704420:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050133.704522:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.704614:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152064 00000100:00100000:0.0:1789050133.704624:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152064 00000100:00100000:0.0:1789050133.704708:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789050133.704719:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+6:12449:x1875954704152064:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789050133.704736:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.704753:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d93 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.704783:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.704793:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050133.704797:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050133.704803:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.704847:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.704877:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.704892:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983ea9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714684672:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050133.705112:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050133.707895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.708062:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983ea9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875954714684672:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050133.708098:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.708120:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0200, rc 0) 00000100:00100000:0.0:1789050133.708175:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:12449:x1875954704152064:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3457us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.708183:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:1.0:1789050133.708810:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152192 00000100:00100000:1.0:1789050133.708829:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152192 00010000:00010000:1.0:1789050133.708863:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.708901:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:1.0:1789050133.708912:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704152192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050133.708925:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050133.708982:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.708995:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.709018:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c195afa7/0x3b8ec5973df5820f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d8c expref: 7 pid: 8432 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.709032:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050133.709036:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050133.709045:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.709055:0:7460:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.709109:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.709125:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1875954714684800:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789050133.709185:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050133.712739:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1875954714684800:192.168.203.42@tcp:105: 00010000:00010000:1.0:1789050133.712765:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050133.712877:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704152192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3965us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050133.712888:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:3.0:1789050133.716205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.716309:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152448 00000100:00100000:0.0:1789050133.716319:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152448 00000100:00100000:0.0:1789050133.716375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:0.0:1789050133.716385:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+43:12449:x1875954704152448:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:0.0:1789050133.716617:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789050133.716730:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+45:12449:x1875954704152448:12345-192.168.203.42@tcp:35:bash.0 Request processed in 346us (534us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1789050133.716738:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000020:00080000:0.0:1789050133.716743:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050133.888508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.888639:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152576 00000100:00100000:0.0:1789050133.888649:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152576 00000100:00100000:0.0:1789050133.888733:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:0.0:1789050133.888746:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+45:12465:x1875954704152576:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050133.888773:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.888795:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5821d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966d9a expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.888875:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.888890:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.888903:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050133.889371:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789050133.889376:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050133.889398:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.889424:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5821d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d9a expref: 47 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.889441:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d9a expref: 46 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.889449:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050133.889452:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050133.889455:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1200, rc 0) 00000100:00100000:0.0:1789050133.889514:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+46:12465:x1875954704152576:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 772us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.889530:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:2.0:1789050133.894749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050133.894969:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152832 00000100:00100000:3.0:1789050133.894979:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152832 00000100:00100000:3.0:1789050133.895037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:3.0:1789050133.895048:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+46:12465:x1875954704152832:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050133.895068:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050133.895087:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df5822b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966da1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.895211:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df58232 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.895226:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df58232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.895238:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df58232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050133.895260:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789050133.895369:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df5822b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da1 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.895387:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df58232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da1 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.895396:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:3.0:1789050133.895399:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050133.895404:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603600, rc 0) 00000100:00100000:3.0:1789050133.895742:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+48:12465:x1875954704152832:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 694us (1002us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789050133.895750:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:2.0:1789050133.901689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.901776:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153088 00000100:00100000:1.0:1789050133.901786:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153088 00000100:00100000:1.0:1789050133.901857:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:1.0:1789050133.901867:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+48:12465:x1875954704153088:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050133.901889:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050133.901909:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966da8 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.902050:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.902067:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.902080:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050133.902113:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789050133.902223:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da8 expref: 51 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.902242:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da8 expref: 50 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.902265:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:1.0:1789050133.902268:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789050133.902272:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571600, rc 0) 00000100:00100000:1.0:1789050133.902325:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+50:12465:x1875954704153088:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 459us (646us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789050133.902333:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:0.0:1789050133.904652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050133.904725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153216 00000100:00100000:3.0:1789050133.904735:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153216 00000100:00100000:3.0:1789050133.904793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:3.0:1789050133.904803:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+50:2405:x1875954704153216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050133.904826:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050133.904866:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df58232 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da1 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.904883:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:3.0:1789050133.904888:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050133.905201:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+49:2405:x1875954704153216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 398us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050133.905209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789050133.911455:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.911538:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153344 00000100:00100000:1.0:1789050133.911549:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153344 00000100:00100000:1.0:1789050133.911610:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:1.0:1789050133.911621:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+6:2404:x1875954704153344:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1789050133.911667:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.911687:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.911696:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789050133.911701:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050133.911706:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.911758:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050133.911772:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 6 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050133.911787:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714684928:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050133.911890:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050133.915383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050133.915487:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1875954714684928:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050133.915516:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050133.915589:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153472 00000100:00100000:2.0:1789050133.915596:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153472 00002000:00100000:2.0:1789050133.915643:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ba983ea9180 x1875954704153472/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:634/0 lens 504/0 e 0 to 0 dl 1789050144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050133.915653:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983ea9180 with x1875954704153472 ext(0->8) 00010000:00010000:2.0:1789050133.915660:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 7 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.915674:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 7 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050133.915683:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983ea9180 00000100:00100000:2.0:1789050133.915712:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:2.0:1789050133.915721:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704153472:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:2.0:1789050133.916866:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704153472:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 1138us (1486us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789050133.916878:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00002000:00100000:2.0:1789050133.916889:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ba983ea9180 x1875954704153472/t4294967309(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:634/0 lens 504/448 e 0 to 0 dl 1789050144 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050133.916899:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983ea9180 with x1875954704153472 ext(0->8) 00010000:00010000:2.0:1789050133.916906:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.916922:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050133.916973:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ba983ea9180 00000100:00100000:2.0:1789050133.920004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.920179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153600 00000100:00100000:0.0:1789050133.920189:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153600 00010000:00010000:0.0:1789050133.920228:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.920379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:0.0:1789050133.920390:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704153600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050133.920405:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789050133.920423:0:6505:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789050133.920426:0:6505:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789050132792401307 00002000:00010000:0.0:1789050133.920429:0:6505:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789050132987422487 00002000:00010000:0.0:1789050133.920432:0:6505:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789050132792401307 00002000:00010000:0.0:1789050133.920434:0:6505:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789050133.920441:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.920455:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.920478:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f180f46/0x3b8ec5973df58216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d93 expref: 9 pid: 8433 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.920496:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050133.920515:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050133.920521:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.920531:0:6505:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.920567:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050133.920621:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704153600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 233us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.920628:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00010000:00010000:2.0:1789050133.920685:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920695:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920713:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920720:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920728:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920734:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050133.920738:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920746:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920757:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.920772:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58255 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050133.920816:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704153344:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 9197us (9372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050133.920834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789050133.923162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050133.923259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153856 00000100:00100000:2.0:1789050133.923269:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153856 00000100:00100000:2.0:1789050133.923330:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789050133.923342:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+49:12465:x1875954704153856:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:2.0:1789050133.923404:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da8 expref: 49 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050133.923637:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00000001:00080000:2.0:1789050133.923681:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000001:00080000:2.0:1789050133.924037:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967498 00010000:00010000:2.0:1789050133.924080:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.924096:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 53 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.924106:0:6522:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.924141:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 53 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.924172:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 53 pid: 13807 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050133.924189:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1875954714685056:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050133.924279:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa874c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050133.927146:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1875954714685056:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050133.927157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1789050133.927181:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050133.927206:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153984 00000100:00100000:3.0:1789050133.927214:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153984 00010000:00010000:3.0:1789050133.927253:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 54 pid: 13807 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050133.927297:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789050133.927349:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+54:2404:x1875954704153984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050133.927364:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050133.927370:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 54 pid: 13807 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927383:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 54 pid: 13807 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927405:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d85 expref: 54 pid: 13807 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927421:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:3.0:1789050133.927441:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927658:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927666:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050133.927762:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050133.927827:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+53:2404:x1875954704153984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 470us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050133.927836:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00010000:00010000:3.0:1789050133.927897:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050133.927905:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050133.928691:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000001:00080000:3.0:1789050133.928813:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000100:00100000:3.0:1789050133.928917:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983e27b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1875954714685184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050133.929412:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050133.929488:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050133.929527:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714685184 00000100:00100000:1.0:1789050133.929535:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714685184 00000100:00100000:1.0:1789050133.929689:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789050133.929698:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875954714685184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789050133.929790:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875954714685184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050133.929797:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1789050133.929833:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050133.929888:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1789050133.929894:0:6522:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1789050133.929912:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983df8380, transno 4294967308 00000100:00100000:0.0:1789050133.929961:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983e27b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1875954714685184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789050133.930082:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000100:00100000:0.0:1789050133.930134:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1875954714685312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789050133.930164:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050133.930620:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050133.930675:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714685312 00000100:00100000:2.0:1789050133.930680:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714685312 00000100:00100000:2.0:1789050133.930707:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789050133.930715:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875954714685312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050133.930836:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875954714685312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (671us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789050133.930844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789050133.930906:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983eaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1875954714685312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789050133.930978:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00010000:00010000:0.0:1789050133.931011:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931021:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931029:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931052:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050133.931057:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931065:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931080:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:0.0:1789050133.931083:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789050133.931088:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.931095:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df5825c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050133.931184:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789050133.931237:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789050133.931261:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356129323332ns, next at 357129320909ns, rc = 0 00000001:00080000:0.0:1789050133.931269:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00010000:00010000:0.0:1789050133.931291:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590500) 00010000:00010000:0.0:1789050133.931294:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789050133.931301:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571600/0x3b8ec5973df58247 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966da8 expref: 57 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050133.931389:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+56:12465:x1875954704153856:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 8051us (8239us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789050133.931397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000020:00080000:0.0:1789050133.931401:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789050133.933857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050133.934104:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154112 00000100:00100000:0.0:1789050133.934114:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154112 00000100:00100000:0.0:1789050133.934176:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:0.0:1789050133.934187:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+56:12465:x1875954704154112:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050133.934212:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050133.934235:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df58263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966daf expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.934298:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df58263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966daf expref: 57 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.934317:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df58263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966daf expref: 57 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050133.934340:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050133.934344:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050133.934348:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1600, rc 0) 00000100:00100000:0.0:1789050133.934515:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+57:12465:x1875954704154112:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 329us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050133.934521:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:2.0:1789050133.940079:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050133.940172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154368 00000100:00100000:3.0:1789050133.940182:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154368 00000100:00100000:3.0:1789050133.940231:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:3.0:1789050133.940241:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+57:12465:x1875954704154368:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050133.940483:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:12465:x1875954704154368:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 243us (413us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789050133.940490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789050134.018450:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.018634:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154496 00000100:00100000:2.0:1789050134.018644:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154496 00000100:00100000:2.0:1789050134.018711:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:2.0:1789050134.018793:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:12475:x1875954704154496:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789050134.018879:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.018907:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.018919:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019595:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019608:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019617:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019702:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019710:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019855:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050134.019909:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019923:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019955:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019975:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019982:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.019986:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.019995:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020006:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050134.020010:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050134.020014:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020020:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5826a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020034:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020040:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020046:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020050:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.020053:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020069:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020077:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:2.0:1789050134.020080:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050134.020083:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020089:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020098:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020104:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020110:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020114:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.020117:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020124:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020131:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.020133:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050134.020136:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.020151:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df58278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050134.020285:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+58:12475:x1875954704154496:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1562us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050134.020293:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:1.0:1789050134.074401:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.074474:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154752 00000100:00100000:2.0:1789050134.074483:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154752 00000100:00100000:2.0:1789050134.074545:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:2.0:1789050134.074555:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+58:12478:x1875954704154752:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050134.074575:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050134.074597:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5827f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966db6 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074667:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074682:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074695:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074706:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074713:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074742:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074868:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074877:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.074885:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050134.074894:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789050134.075007:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075014:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075020:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075027:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.075031:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075038:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075049:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050134.075052:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050134.075063:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075070:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694200/0x3b8ec5973df58286 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075082:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075088:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075093:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075098:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.075101:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075106:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075113:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:2.0:1789050134.075115:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050134.075118:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075124:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df5828d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075156:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694000/0x3b8ec5973df5827f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 61 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075178:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 60 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.075185:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.075188:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050134.075190:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694400, rc 0) 00000100:00100000:2.0:1789050134.075253:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+60:12478:x1875954704154752:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 699us (862us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789050134.075260:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:0.0:1789050134.079053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.079140:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154880 00000100:00100000:2.0:1789050134.079149:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154880 00000100:00100000:2.0:1789050134.079214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 221 00000100:00100000:2.0:1789050134.079225:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+60:12478:x1875954704154880:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789050134.079301:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079329:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079365:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079372:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079398:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079404:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050134.079408:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079416:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079429:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.079432:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050134.079436:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.079443:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050134.079515:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+60:12478:x1875954704154880:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 291us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050134.079522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 221 00000100:00100000:1.0:1789050134.082142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.082219:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155136 00000100:00100000:3.0:1789050134.082229:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155136 00000100:00100000:3.0:1789050134.082296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789050134.082319:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+60:12478:x1875954704155136:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789050134.082554:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+61:12478:x1875954704155136:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 237us (420us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789050134.082562:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:2.0:1789050134.121743:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050134.121772:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714685440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050134.121852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050134.122233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714685440 00000100:00100000:0.0:1789050134.122241:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714685440 00000100:00100000:0.0:1789050134.122304:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789050134.122314:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714685440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050134.122350:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050134.122405:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714685440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.122431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789050134.122580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714685440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050134.159534:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.163188:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155392 00000100:00100000:3.0:1789050134.163203:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155392 00000100:00100000:3.0:1789050134.164727:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:3.0:1789050134.164747:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+61:12488:x1875954704155392:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789050134.164773:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050134.164777:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789050134.164825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1200/0x3b8ec5973df58224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d9a expref: 61 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.164846:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050134.164852:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050134.164867:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dbd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.165016:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.165030:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 61 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.165045:0:6519:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.165104:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 61 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.165119:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 61 pid: 14070 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050134.165135:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714685568:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050134.165237:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050134.168616:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714685568:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050134.168653:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050134.170351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.170533:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155520 00000100:00100000:3.0:1789050134.170542:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155520 00010000:00010000:3.0:1789050134.170580:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 62 pid: 14070 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050134.170623:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:3.0:1789050134.170632:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+62:2404:x1875954704155520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050134.170647:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050134.170654:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 62 pid: 14070 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170665:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 62 pid: 14070 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170707:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694400/0x3b8ec5973df58294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966db6 expref: 62 pid: 14070 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170722:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050134.170727:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170735:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170742:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.170774:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050134.170830:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+61:2404:x1875954704155520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 199us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050134.170837:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 97 00010000:00010000:2.0:1789050134.171077:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.171087:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050134.171116:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789050134.171242:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.171258:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.171266:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.171269:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050134.171271:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:2.0:1789050134.171318:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+61:12488:x1875954704155392:12345-192.168.203.42@tcp:101:bash.0 Request processed in 6579us (11792us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789050134.171327:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:1.0:1789050134.177545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.177618:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155648 00000100:00100000:2.0:1789050134.177628:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155648 00000100:00100000:2.0:1789050134.177685:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 223 00000100:00100000:2.0:1789050134.177694:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+61:12488:x1875954704155648:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050134.177716:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050134.177734:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dc4 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177765:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177778:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177831:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177971:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 63 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177989:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 62 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.177998:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.178001:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050134.178003:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694600, rc 0) 00000100:00100000:2.0:1789050134.178056:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+62:12488:x1875954704155648:12345-192.168.203.42@tcp:101:bash.0 Request processed in 363us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050134.178064:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 223 00000100:00100000:2.0:1789050134.185588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.185908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155904 00000100:00100000:3.0:1789050134.185919:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155904 00000100:00100000:3.0:1789050134.186020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 224 00000100:00100000:3.0:1789050134.186030:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+62:12488:x1875954704155904:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:3.0:1789050134.186250:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.186268:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.186280:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050134.186349:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000004:00010000:3.0:1789050134.186373:0:6520:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002c578bbb reply state 00000000a6f73dfb transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.186395:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.186403:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050134.186405:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050134.186409:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050134.186511:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+65:12488:x1875954704155904:12345-192.168.203.42@tcp:36:bash.0 Request processed in 481us (931us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789050134.186517:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 224 00000020:00080000:3.0:1789050134.186522:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050134.189230:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.190147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156032 00000100:00100000:2.0:1789050134.190157:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156032 00000100:00100000:2.0:1789050134.190218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 225 00000100:00100000:2.0:1789050134.190227:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+65:12488:x1875954704156032:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050134.190249:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050134.190267:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df582d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dcb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.190367:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.190518:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.190528:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.190562:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.190575:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 66 pid: 6519 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050134.190589:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714685696:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050134.190670:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa874c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050134.195033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.195422:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156160 00000100:00100000:3.0:1789050134.195431:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156160 00010000:00010000:3.0:1789050134.195471:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 67 pid: 6519 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050134.195511:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:3.0:1789050134.195521:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+67:2404:x1875954704156160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050134.195535:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050134.195541:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 67 pid: 6519 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.195554:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 67 pid: 6519 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.195599:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050134.195604:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.195614:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.195621:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.195642:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050134.195692:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98368e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+67:2404:x1875954704156160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 173us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050134.195700:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 98 00010000:00010000:1.0:1789050134.197503:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df582b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dbd expref: 66 pid: 6519 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050134.197526:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714685696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050134.197554:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.197563:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.197569:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050134.197624:0:6518:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789050134.197628:0:6518:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050134.197653:0:6518:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.197684:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694e00/0x3b8ec5973df582d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.197701:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.197726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:1.0:1789050134.197729:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050134.197732:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694c00, rc 0) 00000100:00100000:1.0:1789050134.197843:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+65:12488:x1875954704156032:12345-192.168.203.42@tcp:101:bash.0 Request processed in 7616us (8621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050134.197851:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 225 00000100:00100000:2.0:1789050134.208207:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.208321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156416 00000100:00100000:3.0:1789050134.208332:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156416 00000100:00100000:3.0:1789050134.208389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:3.0:1789050134.208401:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+65:12488:x1875954704156416:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:3.0:1789050134.208632:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+66:12488:x1875954704156416:12345-192.168.203.42@tcp:35:bash.0 Request processed in 232us (435us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1789050134.208640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789050134.295604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.295750:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156544 00000100:00100000:2.0:1789050134.295768:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156544 00000100:00100000:2.0:1789050134.295836:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:2.0:1789050134.295847:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+66:12494:x1875954704156544:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789050134.295871:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050134.295890:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dd2 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.296007:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.296043:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.296055:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050134.297081:0:14070:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789050134.297088:0:14070:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050134.297117:0:14070:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.297148:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695a00/0x3b8ec5973df582e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd2 expref: 68 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.297168:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd2 expref: 67 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.297177:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:2.0:1789050134.297180:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050134.297183:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695800, rc 0) 00000100:00100000:2.0:1789050134.297248:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704156544:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1402us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050134.297256:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:0.0:1789050134.303379:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.304586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156672 00000100:00100000:3.0:1789050134.304599:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156672 00000100:00100000:3.0:1789050134.304683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 227 00000100:00100000:3.0:1789050134.304696:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704156672:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050134.304717:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050134.304763:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df582ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dd9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304841:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304855:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304867:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304877:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304884:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304891:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.304990:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305000:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305008:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050134.305047:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789050134.305051:0:6520:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050134.305081:0:6520:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305806:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305822:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305830:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305835:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050134.305840:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305848:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305861:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050134.305864:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050134.305869:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305876:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df582f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305891:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305898:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305912:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305917:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050134.305921:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.305928:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.306278:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:3.0:1789050134.306282:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050134.306286:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.306293:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df582fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.306330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df582ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd9 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.306344:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd9 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.306350:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050134.306352:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050134.306354:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:3.0:1789050134.306420:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+68:12494:x1875954704156672:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1727us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050134.306436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 227 00000100:00100000:1.0:1789050134.317023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050134.317150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156800 00000100:00100000:0.0:1789050134.317162:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156800 00000100:00100000:0.0:1789050134.317233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050134.317243:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+68:2405:x1875954704156800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050134.317260:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050134.317297:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602400/0x3b8ec5973df58304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd9 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.317320:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050134.317326:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050134.317395:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+67:2405:x1875954704156800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 154us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.317402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050134.322437:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050134.322854:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157056 00000100:00100000:3.0:1789050134.322864:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157056 00000100:00100000:3.0:1789050134.322929:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:3.0:1789050134.322967:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704157056:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050134.322988:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050134.323009:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5830b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966de0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.323183:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.323199:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.323209:0:6519:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.323242:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.323313:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 68 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050134.323330:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714685824:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050134.323427:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050134.331904:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050134.332137:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157184 00000100:00100000:0.0:1789050134.332146:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157184 00010000:00010000:0.0:1789050134.332188:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 69 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050134.332249:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:0.0:1789050134.332260:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+69:2404:x1875954704157184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050134.332274:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050134.332280:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 69 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.332306:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 69 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.332330:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050134.332335:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.332345:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.332352:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.332372:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050134.332433:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+69:2404:x1875954704157184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 175us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.332441:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 99 00010000:00010000:3.0:1789050134.333365:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df582da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dcb expref: 68 pid: 6518 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050134.333397:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1875954714685824:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050134.333428:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.333437:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.333443:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050134.333476:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789050134.333619:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5830b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.333636:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050134.333644:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050134.333647:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050134.333650:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603c00, rc 0) 00000100:00100000:3.0:1789050134.333714:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+68:12494:x1875954704157056:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10776us (11286us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789050134.334162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:1.0:1789050134.341546:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050134.341932:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157440 00000100:00100000:2.0:1789050134.341960:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157440 00000100:00100000:2.0:1789050134.342024:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:2.0:1789050134.342035:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+68:12494:x1875954704157440:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:2.0:1789050134.342053:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050134.342092:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df58263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966daf expref: 68 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050134.342110:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050134.342115:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050134.342177:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704157440:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 143us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050134.342185:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:2.0:1789050134.344918:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050134.345028:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157568 00000100:00100000:0.0:1789050134.345036:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157568 00000100:00100000:0.0:1789050134.345092:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 229 00000100:00100000:0.0:1789050134.345102:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704157568:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:0.0:1789050134.345210:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.345227:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050134.345240:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050134.345349:0:13807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789050134.345420:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704157568:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 319us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.345428:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 229 00000100:00100000:0.0:1789050134.352577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050134.352714:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157696 00000100:00100000:1.0:1789050134.352735:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157696 00000100:00100000:1.0:1789050134.352797:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:1.0:1789050134.352807:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+67:12494:x1875954704157696:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050134.352839:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050134.352861:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966de7 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.352922:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.353000:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 68 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.353041:0:10357:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.353055:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 68 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.353096:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:1.0:1789050134.353100:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050134.353104:0:10357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 68 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050134.353112:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571000, rc 0) 00000100:00100000:1.0:1789050134.353511:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+68:12494:x1875954704157696:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 705us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050134.353519:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 230 00010000:00010000:1.0:1789050134.697239:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050135.145644:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050135.145654:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050135.145729:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789050135.145739:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050135.145914:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714685952:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050135.146053:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789050135.149370:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714685952:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050135.156437:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.157042:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157824 00000100:00100000:1.0:1789050135.157057:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157824 00000100:00100000:1.0:1789050135.157155:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:1.0:1789050135.157168:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+68:12495:x1875954704157824:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050135.157212:0:6518:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1789050135.157340:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050135.161258:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+68:12495:x1875954704157824:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 4067us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.161279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:3.0:1789050135.169200:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.169388:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157952 00000100:00100000:2.0:1789050135.169415:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157952 00000100:00100000:2.0:1789050135.169496:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 232 00000100:00100000:2.0:1789050135.169508:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+68:12495:x1875954704157952:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789050135.169610:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169644:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169662:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169682:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169690:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169697:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169746:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169757:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169764:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050135.169840:0:13807:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789050135.169845:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050135.169861:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169873:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169880:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169887:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169894:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.169898:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169907:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169920:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:2.0:1789050135.169930:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.169973:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169981:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df5832e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.169999:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170005:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170012:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170017:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.170020:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170027:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170035:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.170037:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.170041:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170046:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df58335 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170060:0:13807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170071:0:13807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170077:0:13807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170081:0:13807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.170084:0:13807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170090:0:13807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170097:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050135.170099:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.170102:0:13807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.170107:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df5833c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.170204:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+68:12495:x1875954704157952:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 697us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.170213:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 232 00000100:00100000:3.0:1789050135.181616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.181861:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158208 00000100:00100000:2.0:1789050135.181880:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158208 00000100:00100000:2.0:1789050135.182094:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 233 00000100:00100000:2.0:1789050135.182108:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa82cedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+68:12495:x1875954704158208:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050135.182149:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050135.182204:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58343 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182365:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182386:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182401:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050135.182415:0:6520:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789050135.182524:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182533:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182540:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182546:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.182552:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182560:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182587:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050135.182591:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050135.182597:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182615:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5834a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182663:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58343 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dee expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182676:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:2.0:1789050135.182679:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050135.182683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694c00/0x3b8ec5973df58343 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dee expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.182694:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694c00, rc 0) 00000100:00100000:2.0:1789050135.182793:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa82cedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158208:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 688us (1197us total) trans 4294967513 rc 301/301 00000100:00100000:2.0:1789050135.182801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 233 00000100:00100000:0.0:1789050135.186782:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.196502:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158336 00000100:00100000:1.0:1789050135.196531:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158336 00000100:00100000:1.0:1789050135.196709:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:1.0:1789050135.196723:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158336:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050135.196845:0:10357:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050135.197038:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158336:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 318us (10268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.197047:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:2.0:1789050135.200869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.200968:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158592 00000100:00100000:0.0:1789050135.200978:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158592 00000100:00100000:0.0:1789050135.201032:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 235 00000100:00100000:0.0:1789050135.201042:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158592:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050135.201062:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050135.201065:0:13807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050135.201093:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695800/0x3b8ec5973df582e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dd2 expref: 69 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.201113:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050135.201117:0:13807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050135.201130:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df58358 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966df5 expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050135.201565:0:13807:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789050135.202109:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df5835f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.202125:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df5835f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.202136:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df5835f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.202196:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0c00/0x3b8ec5973df58358 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966df5 expref: 71 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.202212:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df5835f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966df5 expref: 70 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.202220:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baaae590500) 00010000:00010000:0.0:1789050135.202222:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050135.202225:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0800, rc 0) 00000100:00100000:0.0:1789050135.202294:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+70:12495:x1875954704158592:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1252us (1434us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789050135.202304:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 235 00000100:00100000:0.0:1789050135.215514:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.220929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158848 00000100:00100000:3.0:1789050135.220983:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158848 00000100:00100000:3.0:1789050135.221075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:3.0:1789050135.221087:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+70:12495:x1875954704158848:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050135.221174:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050135.221209:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0800/0x3b8ec5973df5835f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966df5 expref: 70 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221234:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baaae590500) 00010000:00010000:3.0:1789050135.221246:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050135.221271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221302:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221318:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221326:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221333:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221529:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221609:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221638:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221644:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050135.221651:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221659:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050135.221680:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050135.221685:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603200/0x3b8ec5973df5836d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221708:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221715:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221721:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221726:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050135.221729:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221745:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221754:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x70c90984 (ffff8baa83dbb800) 00010000:00010000:3.0:1789050135.221757:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050135.221760:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.221767:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df58374 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x70c90984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.221895:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158848:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 806us (6392us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050135.221905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:1.0:1789050135.228439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.228863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158976 00000100:00100000:2.0:1789050135.228880:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158976 00000100:00100000:2.0:1789050135.229025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00100000:2.0:1789050135.229039:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+69:12495:x1875954704158976:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050135.229073:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050135.229107:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5837b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966dfc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229555:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229594:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229609:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695000/0x3b8ec5973df5837b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229848:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 70 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.229858:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.229861:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050135.229866:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695e00, rc 0) 00000100:00100000:2.0:1789050135.230241:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+70:12495:x1875954704158976:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1204us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.230251:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00100000:2.0:1789050135.236648:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.236774:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159232 00000100:00100000:1.0:1789050135.236787:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159232 00000100:00100000:1.0:1789050135.236875:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:1.0:1789050135.236887:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+70:12495:x1875954704159232:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050135.237048:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.237072:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.237086:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050135.237291:0:14070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789050135.237303:0:14070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357435364745ns, next at 358435361880ns, rc = 0 00000004:00010000:1.0:1789050135.237688:0:14070:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000032865847 reply state 00000000408996a5 transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.237706:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.237715:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:1.0:1789050135.237719:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789050135.237724:0:14070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050135.237882:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+72:12495:x1875954704159232:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 994us (1247us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789050135.237912:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:0.0:1789050135.244909:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.245154:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159360 00000100:00100000:1.0:1789050135.245168:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159360 00000100:00100000:1.0:1789050135.245292:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:1.0:1789050135.245306:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+72:12495:x1875954704159360:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050135.245346:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050135.245374:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e03 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.245451:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 73 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.245469:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 73 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.245488:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:1.0:1789050135.245492:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050135.245495:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571c00, rc 0) 00000100:00100000:1.0:1789050135.245618:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+73:12495:x1875954704159360:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 315us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.245626:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:0.0:1789050135.248533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.248751:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159488 00000100:00100000:1.0:1789050135.248761:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159488 00000100:00100000:1.0:1789050135.248910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:1.0:1789050135.248921:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2403:x1875954704159488:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789050135.249133:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+10:2403:x1875954704159488:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 213us (609us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789050135.249153:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00080000:3.0:1789050135.249856:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050135.253574:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.253759:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159744 00000100:00100000:0.0:1789050135.253772:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159744 00000100:00100000:0.0:1789050135.253871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789050135.253882:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+73:12495:x1875954704159744:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050135.257851:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+74:12495:x1875954704159744:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 3955us (4276us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789050135.257869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789050135.268031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.268165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160000 00000100:00100000:3.0:1789050135.268176:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160000 00000100:00100000:3.0:1789050135.268240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:3.0:1789050135.268251:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+74:12495:x1875954704160000:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050135.268523:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+74:12495:x1875954704160000:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 272us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.268531:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:1.0:1789050135.273234:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.273408:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160128 00000100:00100000:0.0:1789050135.273418:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160128 00000100:00100000:0.0:1789050135.273528:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:0.0:1789050135.273537:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+74:12495:x1875954704160128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050135.273564:0:13807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050135.273594:0:13807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58397 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e0a expref: -99 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273670:0:13807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273685:0:13807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273697:0:13807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050135.273745:0:13807:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050135.273766:0:13807:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273792:0:13807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1000/0x3b8ec5973df58397 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e0a expref: 76 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273840:0:13807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e0a expref: 75 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.273849:0:13807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:0.0:1789050135.273852:0:13807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789050135.273856:0:13807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1e00, rc 0) 00000100:00100000:0.0:1789050135.274033:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+75:12495:x1875954704160128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 496us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050135.274040:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:0.0:1789050135.277334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.277796:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160256 00000100:00100000:1.0:1789050135.277818:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160256 00000100:00100000:1.0:1789050135.277879:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:1.0:1789050135.277889:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+10:2404:x1875954704160256:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050135.277907:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050135.277928:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e11 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050135.278175:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb9e4cda5340, blocks: 0x0 00010000:00010000:1.0:1789050135.278196:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789050135.278201:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050135.278210:0:8629:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 11 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.278230:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 11 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.278243:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571200, rc 0) 00000100:00100000:1.0:1789050135.278332:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+11:2404:x1875954704160256:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 444us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.278339:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:2.0:1789050135.294244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.294356:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160512 00000100:00100000:3.0:1789050135.294367:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160512 00000100:00100000:1.0:1789050135.294982:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:1.0:1789050135.294998:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+75:12495:x1875954704160512:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789050135.295133:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+75:12495:x1875954704160512:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 140us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.295141:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:1.0:1789050135.301897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.302040:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160640 00000100:00100000:0.0:1789050135.302050:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160640 00000100:00100000:0.0:1789050135.302146:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:0.0:1789050135.302156:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+11:12495:x1875954704160640:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050135.302176:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050135.302196:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e18 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.302231:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.302241:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050135.302246:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050135.302252:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.302310:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.302325:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.302339:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875954714686080:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789050135.302437:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050135.307161:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875954714686080:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050135.307206:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.307226:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1c00, rc 0) 00000100:00100000:2.0:1789050135.307326:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+12:12495:x1875954704160640:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 5170us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.307335:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:2.0:1789050135.310777:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.310879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160768 00000100:00100000:0.0:1789050135.310889:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160768 00010000:00010000:0.0:1789050135.310932:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.311253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:0.0:1789050135.311265:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+12:2403:x1875954704160768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050135.311281:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050135.311302:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.311317:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.311341:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df583a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e11 expref: 12 pid: 8629 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.311380:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050135.311384:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050135.311392:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.311402:0:6505:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.311444:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.311460:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1875954714686208:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789050135.311542:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050135.324294:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.324426:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1875954714686208:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789050135.324455:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050135.324519:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+11:2403:x1875954704160768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13256us (14289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050135.324531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:2.0:1789050135.327455:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160896 00000100:00100000:2.0:1789050135.327470:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160896 00002000:00100000:2.0:1789050135.327535:0:8439:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ba983790e00 x1875954704160896/t0(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:636/0 lens 504/0 e 0 to 0 dl 1789050146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050135.327547:0:8439:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983790e00 with x1875954704160896 ext(0->12) 00002000:00010000:2.0:1789050135.327554:0:8439:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983790e00 00000100:00100000:2.0:1789050135.327649:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789050135.327659:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:615c64c6-0403-4edc-8952-4a12704f5533+11:2403:x1875954704160896:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789050135.329597:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:615c64c6-0403-4edc-8952-4a12704f5533+13:2403:x1875954704160896:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 1930us (5305us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789050135.329611:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00002000:00100000:2.0:1789050135.329622:0:8439:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ba983790e00 x1875954704160896/t4294967321(0) o4->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:636/0 lens 504/448 e 0 to 0 dl 1789050146 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050135.329633:0:8439:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba983790e00 with x1875954704160896 ext(0->12) 00002000:00010000:2.0:1789050135.329639:0:8439:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba983790e00 00000100:00100000:1.0:1789050135.333584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.333682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161024 00000100:00100000:3.0:1789050135.333691:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161024 00000100:00100000:3.0:1789050135.333748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 243 00000100:00100000:3.0:1789050135.333759:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+75:12495:x1875954704161024:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789050135.344212:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000004:00080000:1.0:1789050135.344231:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1789050135.344271:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789050135.344296:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baab0fcda80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789050135.344302:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba982101600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baab0fcd6c0 00000020:00080000:1.0:1789050135.344305:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8baaa2299800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba983d2e400 00000004:00080000:1.0:1789050135.344333:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789050135.344358:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baa82cfb840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789050135.344361:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba9825fcc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baa82cfb180 00000020:00080000:1.0:1789050135.344364:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba9825fce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba983534400 00000020:00080000:1.0:1789050135.344376:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789050135.344571:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050135.344594:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714686336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789050135.344664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050135.344831:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+27:12495:x1875954704161024:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 11071us (11256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.344841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 243 00000020:00080000:3.0:1789050135.345016:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789050135.345079:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789050135.345099:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714686336 00000100:00100000:3.0:1789050135.345108:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714686336 00000100:00100000:3.0:1789050135.345151:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789050135.345160:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714686336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789050135.345187:0:8432:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1789050135.345220:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb9df274dd9b, atime: 0x18d3fb9dfe14a717, ctime: 0x18d3fb9df274dd9b, blocks: 0x8 00010000:00010000:3.0:1789050135.345229:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.345246:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789050135.345251:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050135.345258:0:8432:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.345275:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.345286:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.345309:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.345325:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789050135.345489:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714686336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (825us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789050135.345500:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789050135.345520:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789050135.345556:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba98369ca80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789050135.345563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714686336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789050135.345879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714686592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789050135.345918:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050135.345981:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050135.345987:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714686464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050135.346008:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050135.346042:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714686592 00000100:00100000:0.0:1789050135.346047:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714686592 00000100:00100000:0.0:1789050135.346079:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714686464 00000100:00100000:0.0:1789050135.346081:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714686464 00000100:00100000:0.0:1789050135.346092:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789050135.346098:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714686592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789050135.346185:0:8434:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789050135.346188:0:8434:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789050134399663068 00002000:00010000:0.0:1789050135.346191:0:8434:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789050135.346193:0:8434:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789050134309000000 -> 1789050134399663068 00002000:00010000:0.0:1789050135.346195:0:8434:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789050135.346225:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1875954714686592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (306us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789050135.346232:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1789050135.346245:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.346250:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789050135.346259:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714686464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789050135.346270:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789050135.346270:0:8434:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1789050135.346282:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.346285:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346307:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.346315:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.346316:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346333:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.346334:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789050135.346343:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050135.346348:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346354:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8baaae575f00) 00010000:00010000:2.0:1789050135.346358:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.346363:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346381:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df580b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.346403:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346409:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346417:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.346422:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 12 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346426:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346442:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.346446:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.346451:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714686720:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050135.346455:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346477:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8baaae590000) 00010000:00010000:2.0:1789050135.346480:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.346483:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346490:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0a00/0x3b8ec5973df58159 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346509:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346516:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.346517:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82fbe780 going to sleep for 11 seconds 00000100:00080000:0.0:1789050135.346531:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789050135.346553:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983f59c00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789050135.346559:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714686592:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789050135.346882:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346889:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.346892:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346898:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346907:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:2.0:1789050135.346910:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.346913:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346920:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df581d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346991:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.346999:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347004:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347009:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.347013:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347019:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347027:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa9307b200) 00010000:00010000:2.0:1789050135.347030:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.347033:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347039:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df581fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347054:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347060:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347066:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347078:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.347081:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347087:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347096:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:2.0:1789050135.347098:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050135.347101:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347107:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df582cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347120:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347126:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347131:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347212:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.347216:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347219:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050135.347223:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347229:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347245:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:1.0:1789050135.347248:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050135.347250:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050135.347254:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347276:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347293:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347299:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aceaa327/0x3b8ec5973df583b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.347317:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050135.347318:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050135.347320:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050135.347355:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.347363:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570800/0x3b8ec5973df58389 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.358026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.358062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.358305:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714686720:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050135.358337:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.358450:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161280 00000100:00100000:2.0:1789050135.358458:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161280 00000100:00100000:2.0:1789050135.358513:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:2.0:1789050135.358523:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2405:x1875954704161280:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789050135.362102:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161152 00000100:00100000:3.0:1789050135.362120:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161152 00010000:00010000:3.0:1789050135.362168:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 14 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.362258:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:3.0:1789050135.362269:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+14:2404:x1875954704161152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050135.362285:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050135.362291:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 14 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.362305:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 14 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.362525:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58167 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d70 expref: 14 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.362543:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050135.362546:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050135.362553:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.362563:0:6503:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.362594:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050135.362658:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+13:2404:x1875954704161152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 390us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.362665:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 101 00010000:00010000:0.0:1789050135.364046:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.364064:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.364077:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.364103:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.364130:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050135.364230:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050135.364238:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.364247:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050135.364251:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.364260:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.364279:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.364286:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49f8a63/0x3b8ec5973df583ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.364317:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050135.364319:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050135.364322:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050135.364349:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1875954714686464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18087us (18336us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789050135.364358:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789050135.364396:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba983f58e00/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789050135.364404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714686464:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789050135.373423:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789050135.373440:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1789050135.373992:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704161280:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 15464us (15922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.374004:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:1.0:1789050135.381062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.381816:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161536 00000100:00100000:2.0:1789050135.381828:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161536 00000100:00100000:2.0:1789050135.381900:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 244 00000100:00100000:2.0:1789050135.381910:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+21:12495:x1875954704161536:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050135.382005:0:14070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050135.382032:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1e00/0x3b8ec5973df5839e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e0a expref: 21 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.382052:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.382057:0:14070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050135.382087:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.382101:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.382112:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050135.383275:0:14070:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000046908123 reply state 0000000059ea3d56 transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.383319:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.383327:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.383330:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050135.383333:0:14070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050135.383646:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+22:12495:x1875954704161536:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 1734us (2591us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789050135.383654:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 244 00000100:00100000:0.0:1789050135.387310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.387671:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161664 00000100:00100000:2.0:1789050135.387684:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161664 00000100:00100000:2.0:1789050135.387791:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:2.0:1789050135.387802:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2404:x1875954704161664:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789050135.388028:0:8433:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789050135.388032:0:8433:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789050134399663068 -> 1789050133259000000 00002000:00010000:2.0:1789050135.388035:0:8433:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789050132987000000 00002000:00010000:2.0:1789050135.388037:0:8433:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789050134399663068 -> 1789050133259000000 00002000:00010000:2.0:1789050135.388040:0:8433:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789050135.388105:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704161664:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 305us (804us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789050135.388113:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:1.0:1789050135.398743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.398849:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161920 00000100:00100000:2.0:1789050135.398861:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161920 00000100:00100000:2.0:1789050135.399562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 245 00000100:00100000:2.0:1789050135.399577:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+22:12495:x1875954704161920:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789050135.399672:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.399690:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.399700:0:6520:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.399736:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.399750:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 22 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.399765:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714686848:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050135.400115:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8781bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050135.404802:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.405482:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162048 00000100:00100000:3.0:1789050135.405493:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162048 00010000:00010000:3.0:1789050135.405532:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 23 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.405573:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:3.0:1789050135.405582:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+23:2403:x1875954704162048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050135.405597:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050135.405604:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 23 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.405634:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 23 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.405656:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:3.0:1789050135.405662:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.405672:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.405679:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.405697:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050135.405747:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615c64c6-0403-4edc-8952-4a12704f5533+23:2403:x1875954704162048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 166us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.405755:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 102 00010000:00010000:2.0:1789050135.407321:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dfc expref: 22 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.407346:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1875954714686848:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050135.407371:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407382:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407389:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407451:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407459:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407466:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407471:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050135.407476:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407483:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407500:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.407503:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789050135.407507:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.407512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df583c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.407629:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+21:12495:x1875954704161920:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 8055us (8894us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789050135.407640:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 245 00000100:00100000:1.0:1789050135.410635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.410802:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162176 00000100:00100000:3.0:1789050135.410821:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162176 00000100:00100000:3.0:1789050135.410879:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:3.0:1789050135.410888:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+8:2403:x1875954704162176:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789050135.410968:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.410988:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.411017:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050135.411021:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050135.411026:0:8434:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.411063:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.411077:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 8 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.411093:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714686976:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050135.411175:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050135.413829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.413915:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162304 00000100:00100000:0.0:1789050135.413925:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162304 00010000:00010000:0.0:1789050135.414006:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 9 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.414044:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:0.0:1789050135.414054:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704162304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050135.414195:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050135.414220:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 9 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.414234:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 9 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.414272:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050135.414291:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050135.414297:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.414307:0:6505:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.414330:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050135.414377:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615c64c6-0403-4edc-8952-4a12704f5533+9:2404:x1875954704162304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 324us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050135.414385:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 103 00010000:00010000:3.0:1789050135.414541:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007645cbb5/0x3b8ec5973df583ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e18 expref: 8 pid: 8433 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.414556:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875954714686976:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050135.414578:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414588:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414595:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414626:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414634:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414641:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414649:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050135.414653:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414663:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414675:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.414682:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d57ae12/0x3b8ec5973df583cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.414729:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704162176:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 3842us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.414737:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:1.0:1789050135.418353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.418464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162560 00000100:00100000:3.0:1789050135.418474:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162560 00000100:00100000:3.0:1789050135.418530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 246 00000100:00100000:3.0:1789050135.418539:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+21:12495:x1875954704162560:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789050135.418612:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.418629:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 21 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.418639:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.418673:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 21 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.418687:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 21 pid: 14070 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.418700:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687104:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789050135.418785:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050135.420883:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687104:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050135.420909:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.422918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.425167:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162688 00000100:00100000:3.0:1789050135.425184:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162688 00010000:00010000:0.0:1789050135.425401:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 22 pid: 14070 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.425491:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:0.0:1789050135.425502:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+22:2403:x1875954704162688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050135.425524:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050135.425531:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 22 pid: 14070 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425546:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 22 pid: 14070 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425571:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694600/0x3b8ec5973df582c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966dc4 expref: 22 pid: 14070 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425589:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050135.425611:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 21 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425622:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425630:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425638:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.425729:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050135.425797:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+21:2403:x1875954704162688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 297us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050135.425805:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00010000:00010000:1.0:1789050135.426746:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.426771:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.427179:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.427194:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 21 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.427202:0:6518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.427341:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 21 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.427356:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 21 pid: 10357 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.427371:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983790000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687232:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050135.427486:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050135.430179:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983790000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687232:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789050135.430224:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.433559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.433650:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162816 00000100:00100000:1.0:1789050135.433660:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162816 00010000:00010000:1.0:1789050135.433711:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 22 pid: 10357 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.433753:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:1.0:1789050135.433763:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+22:2403:x1875954704162816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050135.433796:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050135.433804:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 22 pid: 10357 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433827:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 22 pid: 10357 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433848:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e03 expref: 22 pid: 10357 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433864:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:1.0:1789050135.433869:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433878:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433886:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.433916:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050135.434008:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:615c64c6-0403-4edc-8952-4a12704f5533+21:2403:x1875954704162816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 246us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.434016:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 105 00010000:00010000:3.0:1789050135.434485:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.434495:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050135.434616:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967518 00000001:00080000:3.0:1789050135.434738:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967519 00000001:00080000:3.0:1789050135.434772:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967520 00000100:00100000:3.0:1789050135.434862:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1875954714687360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789050135.434912:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050135.435181:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050135.436376:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714687360 00000100:00100000:2.0:1789050135.436386:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714687360 00000100:00100000:2.0:1789050135.436498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789050135.436508:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1875954714687360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789050135.436623:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1875954714687360:12345-0@lo:1000:mdt00_000.0 Request processed in 117us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.436631:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789050135.436694:0:6518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789050135.436700:0:6518:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1789050135.436719:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983f59c00, transno 4294967322 00000100:00100000:3.0:1789050135.436744:0:6518:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8ba983f58e00 x1875954714686464/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789050151 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050135.436757:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1875954714687360:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789050135.436892:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967521 00000100:00100000:3.0:1789050135.436984:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1875954714687488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789050135.437017:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050135.437532:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab428d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050135.437589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714687488 00000100:00100000:0.0:1789050135.437596:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714687488 00000100:00100000:0.0:1789050135.437622:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789050135.437629:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1875954714687488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789050135.437744:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1875954714687488:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (725us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789050135.437751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789050135.437834:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1875954714687488:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789050135.437874:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.437899:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.437906:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.437912:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050135.437916:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.437924:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438109:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:3.0:1789050135.438112:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050135.438117:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438124:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df583dd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438150:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438156:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438162:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438168:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050135.438177:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438184:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438194:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050135.438197:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050135.438205:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 24 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438217:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 24 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438225:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 24 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.438455:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 24 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050135.438470:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687616:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789050135.438536:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85e32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050135.442500:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.442536:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162944 00000100:00100000:3.0:1789050135.442545:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162944 00000100:00100000:3.0:1789050135.442602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789050135.442612:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+25:12494:x1875954704162944:12345-192.168.203.42@tcp:49:lfs.0 00000100:00100000:3.0:1789050135.442736:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+25:12494:x1875954704162944:12345-192.168.203.42@tcp:49:lfs.0 Request processed in 124us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.442758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789050135.443121:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1875954714687616:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789050135.443160:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443171:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58320 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443213:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443228:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443241:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443252:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443257:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443263:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443269:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050135.443273:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443279:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443290:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050135.443293:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050135.443297:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443302:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df583e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443319:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443325:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443331:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443336:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050135.443339:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443346:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443359:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050135.443362:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050135.443366:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.443371:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603600/0x3b8ec5973df583d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050135.443537:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+24:12495:x1875954704162560:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 24997us (25192us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789050135.443546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 246 00000020:00080000:0.0:1789050135.443550:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789050135.444396:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050135.444401:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050135.444823:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789050135.444833:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050135.448995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050135.449034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050135.449182:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163456 00000100:00100000:2.0:1789050135.449192:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163456 00000100:00100000:2.0:1789050135.449264:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 247 00000100:00100000:2.0:1789050135.449275:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+24:12494:x1875954704163456:12345-192.168.203.42@tcp:58:lfs.0 00000040:00080000:2.0:1789050135.449460:0:13807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789050135.449548:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:615c64c6-0403-4edc-8952-4a12704f5533+24:12494:x1875954704163456:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 275us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050135.449556:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 247 00000100:00100000:3.0:1789050135.449954:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163200 00000100:00100000:3.0:1789050135.449961:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163200 00000100:00100000:3.0:1789050135.449996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:3.0:1789050135.450004:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+24:12495:x1875954704163200:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789050135.450212:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789050135.450261:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967523 00010000:00010000:3.0:1789050135.450303:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450319:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450330:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450339:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450347:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450353:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050135.450370:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789050135.450441:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+26:12495:x1875954704163200:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 438us (1460us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789050135.450448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000020:00080000:3.0:1789050135.450452:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050135.452559:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050135.452575:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.452588:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050135.452592:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.452601:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.452620:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050135.452623:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789050135.452628:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.452656:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae602200/0x3b8ec5973df583eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050135.452676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050135.452678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050135.452680:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050135.490757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.490858:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163584 00000100:00100000:1.0:1789050135.490868:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163584 00000100:00100000:1.0:1789050135.490968:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 248 00000100:00100000:1.0:1789050135.490980:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+26:12497:x1875954704163584:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050135.491023:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050135.491044:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df583f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e1f expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491110:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491126:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491138:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491153:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491160:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491167:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491235:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491260:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491269:0:10357:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491304:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.491324:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 27 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.491340:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714687744:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050135.491435:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8ac0c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050135.495078:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10357:1875954714687744:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050135.495110:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050135.497777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050135.497865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163840 00000100:00100000:3.0:1789050135.497874:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163840 00000100:00100000:3.0:1789050135.497928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789050135.497960:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+28:6175:x1875954704163840:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789050135.498180:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+29:6175:x1875954704163840:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 243us (410us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789050135.498189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789050135.500792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050135.501222:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163968 00000100:00100000:1.0:1789050135.501232:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163968 00010000:00010000:1.0:1789050135.501281:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 29 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050135.501322:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:1.0:1789050135.501332:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+29:2403:x1875954704163968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050135.501346:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050135.501353:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 29 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501367:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 29 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501389:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae603c00/0x3b8ec5973df58312 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de0 expref: 29 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501436:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:1.0:1789050135.501442:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501453:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501462:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050135.501495:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050135.501620:0:10357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501628:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050135.501683:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789050135.501688:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050135.501708:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501721:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501732:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501739:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501746:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501752:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050135.501757:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501764:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501773:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:0.0:1789050135.501776:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050135.501780:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501796:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df583f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501818:0:10357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501825:0:10357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501832:0:10357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501838:0:10357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050135.501841:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501848:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501856:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8baa860ffb00) 00010000:00010000:0.0:1789050135.501859:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050135.501862:0:10357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501868:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58400 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501902:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df583f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e1f expref: 29 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501978:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e1f expref: 28 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050135.501987:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050135.501990:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050135.501992:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571800, rc 0) 00000100:00100000:1.0:1789050135.502110:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615c64c6-0403-4edc-8952-4a12704f5533+28:2403:x1875954704163968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 778us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.502119:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:0.0:1789050135.502667:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+27:12497:x1875954704163584:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 11687us (11916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050135.502675:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 248 00000100:00100000:1.0:1789050135.658313:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050135.658339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714687872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050135.658423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050135.658501:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714687872 00000100:00100000:1.0:1789050135.658509:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714687872 00000100:00100000:1.0:1789050135.658566:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789050135.658576:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714687872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050135.658597:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789050135.658640:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714687872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050135.658647:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1789050135.658666:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050135.658701:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714687872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050135.659397:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050135.659409:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714688000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050135.659450:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050135.659482:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688000 00000100:00100000:3.0:1789050135.659487:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688000 00000100:00100000:3.0:1789050135.659514:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789050135.659521:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714688000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050135.659533:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050135.659567:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714688000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050135.659573:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789050135.659896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714688000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789050135.728257:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050136.169262:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714688128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050136.169347:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050136.169433:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688128 00000100:00100000:3.0:1789050136.169441:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688128 00000100:00100000:3.0:1789050136.169488:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789050136.169496:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714688128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050136.169516:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1789050136.169555:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714688128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050136.169561:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789050136.169584:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050136.169617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714688128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050136.169860:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714688256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050136.169887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714688384:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170385:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170409:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714688896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170432:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170446:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714689408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170471:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170491:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789050136.170496:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714688512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170519:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170533:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714689024:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170565:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714689536:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170586:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.170616:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688384 00000100:00100000:2.0:1789050136.170621:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688384 00000100:00100000:2.0:1789050136.170654:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789050136.170662:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714688384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170723:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8839590-fd25-4606-bad2-917c49937107+24:3644:x1875954714688384:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.170730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789050136.170759:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688512 00000100:00100000:2.0:1789050136.170763:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688512 00000100:00100000:2.0:1789050136.170785:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689024 00000100:00100000:2.0:1789050136.170788:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689024 00000100:00100000:2.0:1789050136.170822:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689536 00000100:00100000:2.0:1789050136.170825:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689536 00000100:00100000:2.0:1789050136.170842:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789050136.170848:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170880:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714688512:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.170886:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789050136.170898:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789050136.170904:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714689024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.170929:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714689024:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.170962:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789050136.170975:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789050136.170982:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714689536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171009:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714689536:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.171015:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:2.0:1789050136.171036:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050136.171048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714688768:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171106:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.171426:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714689280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171450:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.171469:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789050136.171475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714688640:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.171511:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714689152:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.171539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714689664:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050136.171574:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689408 00000100:00100000:2.0:1789050136.171578:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689408 00000100:00100000:2.0:1789050136.171598:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689280 00000100:00100000:2.0:1789050136.171600:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689280 00000100:00100000:2.0:1789050136.171616:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050136.171622:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714689408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171650:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875954714689408:12345-0@lo:400:kworker.0 Request processed in 28us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.171656:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050136.171667:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050136.171672:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714689280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171700:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714689280:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.171706:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050136.171721:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688896 00000100:00100000:2.0:1789050136.171724:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688896 00000100:00100000:2.0:1789050136.171753:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688640 00000100:00100000:2.0:1789050136.171756:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688640 00000100:00100000:2.0:1789050136.171769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789050136.171774:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714688896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171816:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714688896:12345-0@lo:400:kworker.0 Request processed in 41us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.171822:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789050136.171833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789050136.171839:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714688640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171866:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714688640:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.171871:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789050136.171890:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688768 00000100:00100000:2.0:1789050136.171893:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688768 00000100:00100000:2.0:1789050136.171907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689152 00000100:00100000:2.0:1789050136.171910:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689152 00000100:00100000:2.0:1789050136.171927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689664 00000100:00100000:2.0:1789050136.171930:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689664 00000100:00100000:2.0:1789050136.171962:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789050136.171968:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714688768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.171997:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714688768:12345-0@lo:400:kworker.0 Request processed in 29us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.172003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789050136.172019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789050136.172025:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714689152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172050:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714689152:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.172063:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789050136.172075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789050136.172080:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714689664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172105:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714689664:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050136.172110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:2.0:1789050136.172122:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050136.172155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714688512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714689024:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172176:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714689536:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172183:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714688384:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172192:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714688896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172201:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714689408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714688640:0@lo:400:kworker.0 00010000:00080000:2.0:1789050136.172245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983f2d500 x1875954714689152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050136.172255:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714689152:0@lo:400:kworker.0 00010000:00080000:2.0:1789050136.172263:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983f2e680 x1875954714689664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050136.172271:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714689664:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714688768:0@lo:400:kworker.0 00000100:00100000:2.0:1789050136.172313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714689280:0@lo:400:kworker.0 00000100:00100000:1.0:1789050136.176883:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714688256 00000100:00100000:1.0:1789050136.176897:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714688256 00000100:00100000:1.0:1789050136.176982:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789050136.176993:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714688256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050136.177017:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789050136.177104:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875954714688256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (7215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050136.177112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789050136.177172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714688256:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789050136.318398:0:14759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050136.318407:0:14759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050136.318437:0:14759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789050136.318443:0:14759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789050136.489205:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050136.489215:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050136.489246:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789050136.489257:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050136.489390:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714689792:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789050136.489777:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050136.497127:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875954714689792:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050136.502150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050136.505138:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164096 00000100:00100000:0.0:1789050136.505152:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164096 00000100:00100000:0.0:1789050136.505276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 249 00000100:00100000:0.0:1789050136.505286:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+27:12509:x1875954704164096:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050136.505319:0:6520:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050136.505440:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+27:12509:x1875954704164096:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 156us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050136.505457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 249 00000100:00100000:3.0:1789050136.511869:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050136.511985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164352 00000100:00100000:0.0:1789050136.511997:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164352 00000100:00100000:0.0:1789050136.512067:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:0.0:1789050136.512077:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+27:12509:x1875954704164352:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050136.512096:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050136.512117:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5840e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.512289:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.512304:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.512321:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050136.512338:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789050136.515191:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5840e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e26 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.515219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e26 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.515228:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050136.515231:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050136.515235:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1a00, rc 0) 00000100:00100000:0.0:1789050136.515308:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+29:12509:x1875954704164352:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 3232us (3450us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789050136.515317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:1.0:1789050136.522413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050136.522561:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164480 00000100:00100000:0.0:1789050136.522572:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164480 00000100:00100000:0.0:1789050136.522643:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050136.522653:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+29:2403:x1875954704164480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050136.522671:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050136.522712:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e26 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.522730:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050136.522735:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050136.522792:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615c64c6-0403-4edc-8952-4a12704f5533+28:2403:x1875954704164480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 141us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050136.522810:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789050136.525923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050136.526065:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164736 00000100:00100000:0.0:1789050136.526076:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164736 00000100:00100000:0.0:1789050136.526144:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 251 00000100:00100000:0.0:1789050136.526156:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+28:12509:x1875954704164736:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789050136.526231:0:14070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526247:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526259:0:14070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526402:0:14070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526409:0:14070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526415:0:14070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526420:0:14070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050136.526431:0:14070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526439:0:14070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526466:0:14070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050136.526470:0:14070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050136.526475:0:14070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050136.526482:0:14070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df58423 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050136.526597:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+29:12509:x1875954704164736:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 443us (684us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789050136.526605:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 251 00000040:00080000:1.0:1789050136.527014:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050136.527019:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050136.527461:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789050136.527470:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050136.530615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050136.530739:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164992 00000100:00100000:0.0:1789050136.530749:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164992 00000100:00100000:0.0:1789050136.530813:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:0.0:1789050136.530822:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+29:12509:x1875954704164992:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050136.531398:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+30:12509:x1875954704164992:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 573us (789us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789050136.531407:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00010000:00010000:2.0:1789050136.745596:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050137.032184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032244:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032347:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050137.032414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165120 00000100:00100000:3.0:1789050137.032425:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165120 00000100:00100000:3.0:1789050137.032469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 386 00000100:00100000:3.0:1789050137.032478:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704165120:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050137.032543:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704165120:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050137.032551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 386 00000100:00100000:0.0:1789050137.032821:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165504 00000100:00100000:0.0:1789050137.032826:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165504 00000100:00100000:0.0:1789050137.032872:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165376 00000100:00100000:0.0:1789050137.032875:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165376 00000100:00100000:0.0:1789050137.032897:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:0.0:1789050137.032906:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704165504:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050137.032980:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704165504:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 75us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050137.032987:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:0.0:1789050137.032999:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:0.0:1789050137.033006:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704165376:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050137.033028:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704165376:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050137.033035:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:0.0:1789050137.033058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165248 00000100:00100000:0.0:1789050137.033062:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165248 00000100:00100000:0.0:1789050137.033086:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165760 00000100:00100000:0.0:1789050137.033089:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165760 00000100:00100000:0.0:1789050137.033117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165632 00000100:00100000:0.0:1789050137.033120:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165632 00000100:00100000:0.0:1789050137.033139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 327 00000100:00100000:0.0:1789050137.033145:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704165248:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050137.033171:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704165248:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050137.033177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 327 00000100:00100000:0.0:1789050137.033190:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 328 00000100:00100000:0.0:1789050137.033196:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704165760:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050137.033215:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704165760:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 20us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050137.033220:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 328 00000100:00100000:0.0:1789050137.033230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 329 00000100:00100000:0.0:1789050137.033243:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704165632:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050137.033268:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704165632:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050137.033274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 329 00000100:00080000:3.0:1789050137.034850:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050137.034860:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050137.034863:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050137.034865:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789050137.769337:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050138.183354:0:14810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050138.183363:0:14810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050138.183398:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789050138.183407:0:14810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050138.391282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050138.392043:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166016 00000100:00100000:0.0:1789050138.392053:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166016 00000100:00100000:0.0:1789050138.392135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00100000:0.0:1789050138.392148:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+30:12530:x1875954704166016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050138.392173:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050138.392192:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5842a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.392298:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58431 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.392312:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.392325:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050138.392336:0:6519:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789050138.392430:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5842a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e2d expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.392448:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e2d expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.392479:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050138.392482:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789050138.392485:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1800, rc 0) 00000100:00100000:0.0:1789050138.392554:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+32:12530:x1875954704166016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 410us (1280us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1789050138.392561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00080000:3.0:1789050138.393179:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050138.399082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050138.399200:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166144 00000100:00100000:0.0:1789050138.399210:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166144 00000100:00100000:0.0:1789050138.399280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 253 00000100:00100000:0.0:1789050138.399291:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+32:12530:x1875954704166144:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789050138.399364:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399382:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399394:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399429:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399437:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399443:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399449:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050138.399468:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399476:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399488:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:0.0:1789050138.399491:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050138.399495:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.399502:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1600/0x3b8ec5973df5843f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050138.399655:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:615c64c6-0403-4edc-8952-4a12704f5533+32:12530:x1875954704166144:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 365us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050138.399663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 253 00000100:00100000:2.0:1789050138.495165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050138.495311:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166272 00000100:00100000:0.0:1789050138.495321:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166272 00000100:00100000:0.0:1789050138.495388:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:0.0:1789050138.495399:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+7:2405:x1875954704166272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1789050138.495416:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050138.495439:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058014ce3/0x3b8ec5973df58446 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e34 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050138.495465:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x18d3fb9e0e4498c0, atime: 0x18d3fb9dfe0e34c0, ctime: 0x18d3fb9e0e4498c0, blocks: 0x8 00010000:00010000:0.0:1789050138.495488:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1789050138.495493:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050138.495503:0:8433:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058014ce3/0x3b8ec5973df58446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e34 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.495541:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058014ce3/0x3b8ec5973df58446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e34 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050138.495554:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1600, rc 0) 00000100:00100000:0.0:1789050138.495620:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:615c64c6-0403-4edc-8952-4a12704f5533+8:2405:x1875954704166272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 221us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050138.495626:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:2.0:1789050138.498269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050138.498416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166400 00000100:00100000:1.0:1789050138.498426:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166400 00002000:00100000:1.0:1789050138.498481:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ba98227ca80 x1875954704166400/t0(0) o3->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:639/0 lens 488/0 e 0 to 0 dl 1789050149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789050138.498493:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba98227ca80 with x1875954704166400 ext(0->4095) 00002000:00010000:1.0:1789050138.498499:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba98227ca80 00000100:00100000:1.0:1789050138.498534:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789050138.498560:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704166400:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1789050138.499018:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:615c64c6-0403-4edc-8952-4a12704f5533+8:2404:x1875954704166400:12345-192.168.203.42@tcp:3:cat.0 Request processed in 457us (755us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789050138.499028:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00002000:00100000:1.0:1789050138.499038:0:8438:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ba98227ca80 x1875954704166400/t0(0) o3->615c64c6-0403-4edc-8952-4a12704f5533@192.168.203.42@tcp:639/0 lens 488/4536 e 0 to 0 dl 1789050149 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789050138.499047:0:8438:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba98227ca80 with x1875954704166400 ext(0->4095) 00002000:00010000:1.0:1789050138.499051:0:8438:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ba98227ca80 00000100:00100000:3.0:1789050138.731443:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050138.731469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714689920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050138.731541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050138.731699:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714689920 00000100:00100000:0.0:1789050138.731707:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714689920 00000100:00100000:0.0:1789050138.731760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789050138.731769:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714689920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789050138.731814:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789050138.731871:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714689920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050138.731877:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789050138.732070:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714689920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789050138.793424:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050139.243216:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050139.243244:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714690048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050139.243332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050139.243407:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690048 00000100:00100000:0.0:1789050139.243416:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690048 00000100:00100000:0.0:1789050139.243472:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789050139.243483:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714690048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050139.243526:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050139.243579:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714690048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050139.243596:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789050139.243653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714690048:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789050139.762096:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789050139.762121:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:2.0:1789050139.817333:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050140.777270:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714690176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050140.777294:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714690304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050140.780607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050140.780934:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690304 00000100:00100000:3.0:1789050140.780966:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690304 00000100:00100000:3.0:1789050140.781045:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789050140.781060:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714690304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050140.781112:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050140.781176:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714690304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050140.781184:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1789050140.781216:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050140.781251:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789050140.781260:0:3646:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1789050140.781285:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba98369ca80, transno 4294967311 00000100:00100000:3.0:1789050140.781307:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714690304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050140.781587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050140.783080:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690176 00000100:00100000:2.0:1789050140.783099:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690176 00000100:00100000:2.0:1789050140.783190:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789050140.783201:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714690176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050140.783239:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789050140.783311:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050140.783318:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714690176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050140.783327:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789050140.783397:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714690176:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1789050140.790260:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1789050140.790279:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789050140.795575:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00080000:1.0:1789050140.795615:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8baab428db40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789050140.795621:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98352d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8baab428d0c0 00000020:00080000:1.0:1789050140.795625:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba98352d500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba983ecee00 00010000:00010000:2.0:1789050140.795713:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789050140.795721:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00010000:00010000:2.0:1789050140.795731:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050140.795743:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050140.795785:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050140.795791:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050140.795800:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789050140.795816:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1789050140.795824:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050140.795828:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050140.795835:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050140.795842:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df583c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14070 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789050140.795845:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1789050140.847225:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050141.289823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714690432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.289926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050141.290047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714690944:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.290092:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050141.290117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714691456:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.290151:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050141.290172:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714691968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.290195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.290297:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714690560:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.290333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050141.290447:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690432 00000100:00100000:2.0:1789050141.290457:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690432 00000100:00100000:2.0:1789050141.290517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789050141.290529:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714690432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.290589:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714690432:12345-0@lo:400:kworker.0 Request processed in 63us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050141.290597:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789050141.290637:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691456 00000100:00100000:2.0:1789050141.290640:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691456 00000100:00100000:2.0:1789050141.290672:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691968 00000100:00100000:2.0:1789050141.290674:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691968 00000100:00100000:2.0:1789050141.290709:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789050141.290716:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714691456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.290801:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714691456:12345-0@lo:400:kworker.0 Request processed in 51us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050141.290810:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789050141.290825:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789050141.290832:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714691968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.290866:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714691968:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050141.290873:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789050141.290900:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050141.291006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714690816:0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.291082:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690944 00000100:00100000:2.0:1789050141.291088:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690944 00000100:00100000:2.0:1789050141.291119:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789050141.291127:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac589450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714690944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.291167:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac589450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714690944:12345-0@lo:400:kworker.0 Request processed in 42us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050141.291173:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789050141.291832:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690560 00000100:00100000:2.0:1789050141.291838:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690560 00000100:00100000:3.0:1789050141.292558:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714690944:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714691072:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293247:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293284:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714691584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714692096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050141.293388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293412:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789050141.293420:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714690688:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293528:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293549:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714691200:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293595:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714691712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050141.293680:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.293736:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690688 00000100:00100000:0.0:1789050141.293745:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690688 00000100:00100000:0.0:1789050141.293903:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789050141.293914:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714690688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.293999:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714690688:12345-0@lo:400:kworker.0 Request processed in 87us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.294007:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789050141.294034:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691072 00000100:00100000:0.0:1789050141.294038:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691072 00000100:00100000:1.0:1789050141.295115:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692096 00000100:00100000:1.0:1789050141.295127:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692096 00000100:00100000:1.0:1789050141.295179:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692224 00000100:00100000:1.0:1789050141.295182:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692224 00000100:00100000:1.0:1789050141.295198:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789050141.295207:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714692096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050141.295249:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789050141.295313:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714692096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050141.295320:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789050141.295336:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789050141.295342:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714692224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050141.295360:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789050141.295386:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714692224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050141.295393:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789050141.295413:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691584 00000100:00100000:1.0:1789050141.295417:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691584 00000100:00100000:3.0:1789050141.299394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714691456:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.299586:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789050141.299593:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba983f58e00, transno 4294967323 00000004:00080000:3.0:1789050141.299639:0:3647:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789050141.299681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714691968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050141.301726:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714690432:0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.304786:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789050141.304825:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714690560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.304976:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714690560:12345-0@lo:400:kworker.0 Request processed in 167us (14642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.305302:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691200 00000100:00100000:0.0:1789050141.305313:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691200 00000100:00100000:0.0:1789050141.305353:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691712 00000100:00100000:0.0:1789050141.305356:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691712 00000100:00100000:0.0:1789050141.305375:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789050141.305382:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714691072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.305425:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714691072:12345-0@lo:400:kworker.0 Request processed in 44us (12179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.305430:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789050141.305449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789050141.305454:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714691200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.305481:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714691200:12345-0@lo:400:kworker.0 Request processed in 27us (11905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.306445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789050141.306471:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789050141.306493:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714691712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.306556:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714691712:12345-0@lo:400:kworker.0 Request processed in 77us (12936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.306567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:0.0:1789050141.306599:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050141.306604:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050141.306608:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050141.306653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714690688:0@lo:400:kworker.0 00010000:00080000:0.0:1789050141.306674:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a0380 x1875954714691200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050141.306686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714691200:0@lo:400:kworker.0 00010000:00080000:0.0:1789050141.306697:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a2a00 x1875954714691712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050141.306706:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714691712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.306730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050141.306748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714692096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050141.306762:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714690560:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.306787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714691072:0@lo:400:kworker.0 00000100:00100000:1.0:1789050141.306861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789050141.306875:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714691584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050141.306934:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714691584:12345-0@lo:400:kworker.0 Request processed in 62us (13620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050141.306959:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789050141.307044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050141.307082:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714691328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.307114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714691584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.307135:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714690816 00000100:00100000:1.0:1789050141.307138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.307143:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714690816 00000100:00100000:1.0:1789050141.307172:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714691840:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.307182:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789050141.307191:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714690816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050141.307199:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050141.307233:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714690816:12345-0@lo:400:kworker.0 Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050141.307242:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714690816:0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.307255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789050141.307853:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789050141.307892:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691328 00000100:00100000:2.0:1789050141.307897:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691328 00000100:00100000:2.0:1789050141.307962:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714691840 00000100:00100000:2.0:1789050141.307966:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714691840 00000100:00100000:2.0:1789050141.307998:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789050141.308007:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714691328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.308132:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789050141.308141:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714691840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050141.308211:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714691840:12345-0@lo:400:kworker.0 Request processed in 72us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050141.308217:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789050141.308255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714691840:0@lo:400:kworker.0 00000100:00100000:2.0:1789050141.308387:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714691328:12345-0@lo:400:kworker.0 Request processed in 382us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050141.308395:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789050141.308450:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714691328:0@lo:400:kworker.0 00010000:00010000:2.0:1789050141.865267:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050142.152870:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.152980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153046:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153068:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153089:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050142.153161:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167040 00000100:00100000:3.0:1789050142.153173:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167040 00000100:00100000:3.0:1789050142.153250:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166912 00000100:00100000:3.0:1789050142.153253:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166912 00000100:00100000:3.0:1789050142.153278:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:3.0:1789050142.153290:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704167040:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153492:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704167040:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 203us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.153500:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:3.0:1789050142.153525:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:3.0:1789050142.153533:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704166912:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153560:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704166912:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.153566:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:3.0:1789050142.153587:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166784 00000100:00100000:3.0:1789050142.153602:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166784 00000100:00100000:3.0:1789050142.153635:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167296 00000100:00100000:3.0:1789050142.153637:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167296 00000100:00100000:3.0:1789050142.153654:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166656 00000100:00100000:3.0:1789050142.153656:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166656 00000100:00100000:3.0:1789050142.153670:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167168 00000100:00100000:3.0:1789050142.153673:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167168 00000100:00100000:3.0:1789050142.153688:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 336 00000100:00100000:3.0:1789050142.153694:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704166784:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153726:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704166784:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 32us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.153732:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 336 00000100:00100000:3.0:1789050142.153747:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 337 00000100:00100000:3.0:1789050142.153754:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704167296:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153787:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704167296:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 33us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.153793:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 337 00000100:00100000:0.0:1789050142.153802:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 338 00000100:00100000:3.0:1789050142.153807:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 339 00000100:00100000:0.0:1789050142.153812:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704166656:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153813:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704167168:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.153834:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704167168:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 21us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.153837:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704166656:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.153840:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 339 00000100:00100000:0.0:1789050142.153843:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 338 00000100:00080000:0.0:1789050142.153864:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050142.153868:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050142.153870:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050142.153872:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050142.160267:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166528 00000100:00100000:2.0:1789050142.160293:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166528 00000100:00100000:3.0:1789050142.160620:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 388 00000100:00100000:3.0:1789050142.160634:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704166528:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050142.160734:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704166528:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 102us (7878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.160768:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 388 00000040:00080000:2.0:1789050142.313691:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789050142.697154:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050142.697168:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050142.697299:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789050142.697306:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789050142.901736:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050143.012022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050143.013617:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167424 00000100:00100000:3.0:1789050143.013636:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167424 00000100:00100000:3.0:1789050143.013796:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 254 00000100:00100000:3.0:1789050143.013809:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+18:12175:x1875954704167424:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789050143.014007:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+18:12175:x1875954704167424:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 199us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050143.014016:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 254 00000100:00100000:0.0:1789050143.019039:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050143.019144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167552 00000100:00100000:3.0:1789050143.019158:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167552 00000100:00100000:3.0:1789050143.019327:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 255 00000100:00100000:3.0:1789050143.019340:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:12175:x1875954704167552:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789050143.019492:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:615c64c6-0403-4edc-8952-4a12704f5533+5:12175:x1875954704167552:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 154us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050143.019501:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 255 00000100:00100000:1.0:1789050143.021565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050143.022271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167808 00000100:00100000:0.0:1789050143.022284:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167808 00000100:00100000:0.0:1789050143.022398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:0.0:1789050143.022411:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+18:12175:x1875954704167808:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050143.023396:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:615c64c6-0403-4edc-8952-4a12704f5533+19:12175:x1875954704167808:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 981us (1837us total) trans 4294967530 rc 0/0 00000100:00100000:0.0:1789050143.023412:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:0.0:1789050143.849555:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714692352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050143.849652:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.850794:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692352 00000100:00100000:2.0:1789050143.850812:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692352 00000100:00100000:2.0:1789050143.850895:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789050143.850908:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714692352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050143.851016:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789050143.851790:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714692352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 881us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050143.851801:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789050143.851919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714692352:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789050143.913645:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050144.362470:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050144.362509:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714692480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050144.362614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050144.362736:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692480 00000100:00100000:0.0:1789050144.362757:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692480 00000100:00100000:0.0:1789050144.362827:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789050144.362839:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714692480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050144.362886:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789050144.362982:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714692480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050144.362990:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789050144.363093:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714692480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050144.938180:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050145.158525:0:15008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:22:22 (1789050142) 00000100:00100000:1.0:1789050145.897638:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050145.897668:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714692608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050145.897768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050145.897913:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692608 00000100:00100000:2.0:1789050145.897923:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692608 00000100:00100000:2.0:1789050145.898024:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789050145.898035:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714692608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050145.898070:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050145.898133:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714692608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050145.898141:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789050145.898189:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714692608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789050145.898279:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050145.898482:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050145.898492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714692736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050145.898521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050145.898554:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692736 00000100:00100000:2.0:1789050145.898559:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692736 00000100:00100000:2.0:1789050145.898585:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789050145.898591:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714692736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050145.898602:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050145.898630:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714692736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050145.898637:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789050145.898663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714692736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789050145.898726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789050145.961325:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050146.409474:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714693248:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.409563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050146.409618:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714693760:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.409641:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050146.409670:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789050146.409676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714693120:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.409699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050146.409713:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714693632:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.409741:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050146.409777:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714694144:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.409801:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050146.409829:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693248 00000100:00100000:0.0:1789050146.409837:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693248 00000100:00100000:0.0:1789050146.409885:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693760 00000100:00100000:0.0:1789050146.409889:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693760 00000100:00100000:0.0:1789050146.409915:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693632 00000100:00100000:0.0:1789050146.409917:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693632 00000100:00100000:0.0:1789050146.409958:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789050146.409968:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714693248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.410019:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714693248:12345-0@lo:400:kworker.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050146.410026:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789050146.410047:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789050146.410053:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714693760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.410078:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714693760:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050146.410083:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789050146.410093:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789050146.410098:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714693632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.410122:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714693632:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050146.410127:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:0.0:1789050146.410171:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a1500 x1875954714693632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050146.410186:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714693632:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.410210:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714693248:0@lo:400:kworker.0 00000100:00100000:0.0:1789050146.410218:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714693760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714692992:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410368:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714693504:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410409:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714694016:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410430:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410458:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789050146.410464:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714692864:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410516:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714693376:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714693888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410569:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410593:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694144 00000100:00100000:3.0:1789050146.410596:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694144 00000100:00100000:3.0:1789050146.410623:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694016 00000100:00100000:3.0:1789050146.410626:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694016 00000100:00100000:3.0:1789050146.410646:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789050146.410653:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714694144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410688:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714694144:12345-0@lo:400:kworker.0 Request processed in 35us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.410694:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789050146.410708:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050146.410714:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714694016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410757:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714694016:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.410763:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050146.410779:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692992 00000100:00100000:3.0:1789050146.410782:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692992 00000100:00100000:2.0:1789050146.410793:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050146.410802:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693504 00000100:00100000:2.0:1789050146.410803:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714694272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050146.410804:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693504 00000100:00100000:3.0:1789050146.410816:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693888 00000100:00100000:3.0:1789050146.410818:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693888 00000100:00100000:3.0:1789050146.410830:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789050146.410831:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050146.410843:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714692992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.410870:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693120 00000100:00100000:3.0:1789050146.410871:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714692992:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050146.410874:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693120 00000100:00100000:3.0:1789050146.410877:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789050146.410889:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789050146.410895:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714693504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.410898:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714693376 00000100:00100000:2.0:1789050146.410900:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714693376 00000100:00100000:2.0:1789050146.410913:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789050146.410918:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714693120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410920:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714693504:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.410925:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789050146.410955:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789050146.410962:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714693888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.410985:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714693888:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050146.410986:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714693120:12345-0@lo:400:kworker.0 Request processed in 68us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.410991:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789050146.410997:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1789050146.411007:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050146.411008:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1789050146.411010:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050146.411012:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050146.411013:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714693376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411041:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714693376:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.411047:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714693376:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411047:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:3.0:1789050146.411057:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c12a00 x1875954714693888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050146.411062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714692864 00000100:00100000:2.0:1789050146.411065:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714692864 00000100:00100000:3.0:1789050146.411066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714693888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.411075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714692992:0@lo:400:kworker.0 00000100:00100000:3.0:1789050146.411083:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714693504:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411086:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789050146.411090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714694016:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411092:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714692864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411116:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714692864:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050146.411118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714692864:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789050146.411140:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714693120:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694272 00000100:00100000:3.0:1789050146.411149:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714694144:0@lo:400:kworker.0 00000100:00100000:2.0:1789050146.411149:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694272 00000100:00100000:2.0:1789050146.411170:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789050146.411175:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714694272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050146.411209:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789050146.411250:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714694272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050146.411256:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789050146.411441:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714694400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050146.411470:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050146.411496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694400 00000100:00100000:1.0:1789050146.411500:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694400 00000100:00100000:1.0:1789050146.411527:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789050146.411532:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714694400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050146.411550:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789050146.411579:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714694400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050146.411585:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789050146.411612:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714694400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050146.411708:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714694272:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789050146.936816:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00080000:1.0:1789050146.936834:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789050146.936898:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789050146.936922:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789050146.986594:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050147.255344:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.257130:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167936 00000100:00100000:3.0:1789050147.257144:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167936 00000100:00100000:0.0:1789050147.257372:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 256 00000100:00100000:0.0:1789050147.257386:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:13201:x1875954704167936:12345-192.168.203.42@tcp:101:lsof.0 00010000:00010000:0.0:1789050147.257407:0:10357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050147.257428:0:10357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5844d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e3b expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257488:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257501:0:10357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257513:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050147.257560:0:10357:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789050147.257563:0:10357:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050147.257601:0:10357:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257625:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df5844d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e3b expref: 7 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257644:0:10357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e3b expref: 6 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050147.257675:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:0.0:1789050147.257678:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050147.257681:0:10357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1a00, rc 0) 00000100:00100000:0.0:1789050147.257758:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:13201:x1875954704167936:12345-192.168.203.42@tcp:101:lsof.0 Request processed in 376us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050147.257766:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 256 00000100:00080000:3.0:1789050147.258783:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050147.271746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.271800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.271837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.271880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.271911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050147.271991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050147.272096:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168448 00000100:00100000:1.0:1789050147.272111:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168448 00000100:00100000:2.0:1789050147.272187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168192 00000100:00100000:1.0:1789050147.272189:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168576 00000100:00100000:2.0:1789050147.272193:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168192 00000100:00100000:1.0:1789050147.272195:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168576 00000100:00100000:1.0:1789050147.272227:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:1.0:1789050147.272239:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704168448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050147.272257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168704 00000100:00100000:2.0:1789050147.272262:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168704 00000100:00100000:2.0:1789050147.272295:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168320 00000100:00100000:2.0:1789050147.272299:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168320 00000100:00100000:1.0:1789050147.272333:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704168448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 95us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050147.272336:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 346 00000100:00100000:1.0:1789050147.272346:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:2.0:1789050147.272351:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704168192:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050147.272354:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168064 00000100:00100000:3.0:1789050147.272365:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168064 00000100:00100000:1.0:1789050147.272373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:1.0:1789050147.272386:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704168576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050147.272405:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:2403:x1875954704168192:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 55us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050147.272430:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2403:x1875954704168576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 46us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050147.272440:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 390 00000100:00100000:1.0:1789050147.272453:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:3.0:1789050147.272469:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704168064:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:1.0:1789050147.272484:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789050147.272490:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050147.272492:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050147.272495:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050147.272541:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2403:x1875954704168064:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 78us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050147.272550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 390 00000100:00100000:0.0:1789050147.273504:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 347 00000100:00100000:0.0:1789050147.273524:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704168704:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050147.273570:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2403:x1875954704168704:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 56us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050147.273578:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 347 00000100:00100000:0.0:1789050147.273608:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 348 00000100:00100000:2.0:1789050147.273627:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 346 00000100:00100000:0.0:1789050147.273817:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704168320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050147.273850:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:615c64c6-0403-4edc-8952-4a12704f5533+5:2403:x1875954704168320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 234us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050147.273969:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 348 00010000:00010000:0.0:1789050148.009865:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050148.717753:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050148.718076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168960 00000100:00100000:3.0:1789050148.718087:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168960 00000100:00100000:3.0:1789050148.718154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:3.0:1789050148.718163:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+18:13202:x1875954704168960:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:3.0:1789050148.718421:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:13202:x1875954704168960:12345-192.168.203.42@tcp:35:umount.0 Request processed in 259us (677us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789050148.718443:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:2.0:1789050148.721157:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050148.721237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169216 00000100:00100000:3.0:1789050148.721246:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169216 00000100:00100000:3.0:1789050148.721297:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:3.0:1789050148.721307:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+19:13202:x1875954704169216:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:3.0:1789050148.721594:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+20:13202:x1875954704169216:12345-192.168.203.42@tcp:35:umount.0 Request processed in 287us (444us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1789050148.721602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:2.0:1789050148.724932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050148.725640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169472 00000100:00100000:3.0:1789050148.725651:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169472 00000100:00100000:3.0:1789050148.725722:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789050148.725733:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab0f53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+20:13202:x1875954704169472:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:3.0:1789050148.725991:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab0f53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:13202:x1875954704169472:12345-192.168.203.42@tcp:35:umount.0 Request processed in 258us (1067us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789050148.725998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:2.0:1789050148.729528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050148.729811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169728 00000100:00100000:3.0:1789050148.729819:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169728 00000100:00100000:3.0:1789050148.729881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789050148.729892:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:13202:x1875954704169728:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:3.0:1789050148.730203:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:615c64c6-0403-4edc-8952-4a12704f5533+22:13202:x1875954704169728:12345-192.168.203.42@tcp:35:umount.0 Request processed in 313us (684us total) trans 4294967534 rc 0/0 00000100:00100000:3.0:1789050148.730211:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:2.0:1789050148.734119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050148.734162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050148.734191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050148.734273:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169984 00000100:00100000:1.0:1789050148.734283:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169984 00000100:00100000:1.0:1789050148.734348:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169856 00000100:00100000:1.0:1789050148.734351:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169856 00000100:00100000:1.0:1789050148.734371:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170112 00000100:00100000:1.0:1789050148.734374:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170112 00000100:00100000:1.0:1789050148.734392:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:1.0:1789050148.734401:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+15:2405:x1875954704169984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050148.734418:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050148.734437:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042e00/0x3b8ec5973df5731a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966956 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050148.734454:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050148.734506:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+14:2405:x1875954704169984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050148.734513:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:1.0:1789050148.734531:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789050148.734537:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+13:2405:x1875954704169856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050148.734544:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050148.734552:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df57439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966995 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050148.734562:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050148.734594:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+12:2405:x1875954704169856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050148.734600:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789050148.734613:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:1.0:1789050148.734619:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2405:x1875954704170112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050148.734627:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050148.734636:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603a00/0x3b8ec5973df57654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a6e expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050148.734645:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050148.734660:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704170112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 42us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050148.734666:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:2.0:1789050148.736224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050148.736438:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170496 00000100:00100000:1.0:1789050148.736447:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170496 00000100:00100000:1.0:1789050148.736499:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:1.0:1789050148.736508:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+7:2402:x1875954704170496:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:1.0:1789050148.736538:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df579cd 00000020:00010000:1.0:1789050148.736546:0:8432:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8baaae9e9800: total 0 00000100:00080000:1.0:1789050148.736551:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8baaae9ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789050148.736609:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789050148.736778:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704170496:12345-192.168.203.42@tcp:9:umount.0 Request processed in 270us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050148.736786:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00000020:00010000:2.0:1789050148.736850:0:6507:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8baaae9e9800: total 0 00010000:00010000:2.0:1789050148.736886:0:6507:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8baaae9e9800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789050148.736971:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058014ce3/0x3b8ec5973df58446 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e34 expref: 4 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050148.737006:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf50f33a/0x3b8ec5973df57d85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c58 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050148.737022:0:6507:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8baaae9e9800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789050148.737035:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050148.737050:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050148.737052:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050148.746160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050148.746288:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170624 00000100:00100000:3.0:1789050148.746305:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170624 00000100:00100000:3.0:1789050148.746403:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:3.0:1789050148.746415:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704170624:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:3.0:1789050148.746457:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57757 00000100:00080000:3.0:1789050148.746469:0:8629:0:(import.c:65:import_set_state_nolock()) ffff8baa91f2c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050148.746638:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789050148.747367:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:615c64c6-0403-4edc-8952-4a12704f5533+2:2402:x1875954704170624:12345-192.168.203.42@tcp:9:umount.0 Request processed in 949us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050148.747378:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00010000:00010000:0.0:1789050148.751725:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050148.755679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050148.755797:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171648 00000100:00100000:2.0:1789050148.755811:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171648 00000100:00100000:2.0:1789050148.756288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 257 00000100:00100000:2.0:1789050148.756301:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+22:2402:x1875954704171648:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:2.0:1789050148.756345:0:6519:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5737c 00000020:00010000:2.0:1789050148.756365:0:6519:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8baab4f86800: total 0 00000100:00080000:2.0:1789050148.756371:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8baab7866000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050148.756412:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967534 00000100:00100000:2.0:1789050148.756623:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:615c64c6-0403-4edc-8952-4a12704f5533+21:2402:x1875954704171648:12345-192.168.203.42@tcp:39:umount.0 Request processed in 324us (959us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1789050148.756632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 257 00000020:00010000:3.0:1789050148.757846:0:8449:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8baab4f86800: total 0 00010000:00010000:3.0:1789050148.757964:0:8449:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8baab4f86800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789050148.758011:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050148.758016:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050148.758027:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570200/0x3b8ec5973df580e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966d4d expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758049:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050148.758052:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050148.758056:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df57a28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966b71 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758071:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050148.758075:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050148.758079:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df57de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c6d expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758093:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050148.758096:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050148.758100:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e2d expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758147:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050148.758150:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050148.758154:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df57c66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c0b expref: 16 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758168:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baab0f94200) 00010000:00010000:3.0:1789050148.758170:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050148.758174:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae779a00/0x3b8ec5973df576b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a7c expref: 15 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758192:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050148.758194:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050148.758198:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571000/0x3b8ec5973df58327 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966de7 expref: 14 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758210:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8baaa1a0e100) 00010000:00010000:3.0:1789050148.758212:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789050148.758216:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177c00/0x3b8ec5973df5772d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a98 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758234:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8baaae575700) 00010000:00010000:3.0:1789050148.758237:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789050148.758242:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177600/0x3b8ec5973df57dfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c74 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758256:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8baaae590c00) 00010000:00010000:3.0:1789050148.758258:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050148.758269:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571800/0x3b8ec5973df58407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e1f expref: 11 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758287:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba9832fca00) 00010000:00010000:3.0:1789050148.758289:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050148.758293:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7c00/0x3b8ec5973df576d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a83 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758310:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050148.758312:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050148.758316:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df57d46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c43 expref: 9 pid: 13807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758328:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8baaae580700) 00010000:00010000:3.0:1789050148.758330:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050148.758334:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176200/0x3b8ec5973df57d70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966c51 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050148.758348:0:8449:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8baab4f86800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789050148.758364:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050148.758366:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050148.758368:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050148.771375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050148.771489:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171776 00000100:00100000:0.0:1789050148.771510:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171776 00000100:00100000:0.0:1789050148.771588:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 258 00000100:00100000:0.0:1789050148.771600:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+5:2402:x1875954704171776:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:0.0:1789050148.771659:0:10357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57391 00000100:00080000:0.0:1789050148.771696:0:10357:0:(import.c:65:import_set_state_nolock()) ffff8baab7867000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789050148.771740:0:10357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789050148.772039:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050148.772609:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:615c64c6-0403-4edc-8952-4a12704f5533+3:2402:x1875954704171776:12345-192.168.203.42@tcp:39:umount.0 Request processed in 1007us (1246us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789050148.772626:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 258 00000100:00100000:1.0:1789050148.969824:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050148.969855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714694528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050148.969996:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050148.970066:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694528 00000100:00100000:2.0:1789050148.970079:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694528 00000100:00100000:2.0:1789050148.970151:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789050148.970162:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714694528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050148.970215:0:13086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789050148.970274:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714694528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050148.970281:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789050148.970381:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714694528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050149.033980:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050149.481244:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714694656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050149.481351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050149.481757:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694656 00000100:00100000:2.0:1789050149.481771:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694656 00000100:00100000:2.0:1789050149.481890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789050149.481904:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714694656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789050149.482004:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789050149.482092:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714694656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050149.482100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789050149.482186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714694656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789050150.057492:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050150.190319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050150.190452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050150.190559:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050150.190637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171904 00000100:00100000:2.0:1789050150.190650:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171904 00000100:00100000:2.0:1789050150.190742:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172160 00000100:00100000:2.0:1789050150.190746:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172160 00000100:00100000:2.0:1789050150.190778:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789050150.190789:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+11:2405:x1875954704171904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050150.190808:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050150.190832:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602600/0x3b8ec5973df5748d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669aa expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050150.190865:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050150.190934:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+10:2405:x1875954704171904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 146us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050150.190984:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789050150.191006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789050150.191014:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+9:2405:x1875954704172160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050150.191022:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050150.191033:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603800/0x3b8ec5973df5764d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966a67 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050150.191044:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050150.191063:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:2405:x1875954704172160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 51us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050150.191070:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789050150.191783:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172032 00000100:00100000:0.0:1789050150.191792:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172032 00000100:00100000:3.0:1789050150.191985:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789050150.191996:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+8:2405:x1875954704172032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050150.192017:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050150.192030:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a4000/0x3b8ec5973df57494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad39669db expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050150.192043:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050150.192080:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+7:2405:x1875954704172032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 87us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050150.192087:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:2.0:1789050150.193388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050150.193465:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172416 00000100:00100000:1.0:1789050150.193474:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172416 00000100:00100000:1.0:1789050150.193550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 259 00000100:00100000:1.0:1789050150.193560:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+6:2402:x1875954704172416:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:1.0:1789050150.193610:0:6520:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df574a2 00000020:00010000:1.0:1789050150.193620:0:6520:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8baab7854000: total 0 00000100:00080000:1.0:1789050150.193625:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8baab7852800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789050150.193657:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967535 00000100:00080000:3.0:1789050150.193912:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789050150.193969:0:6507:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8baab7854000: total 0 00010000:00010000:3.0:1789050150.193974:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050150.194035:0:6507:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8baab7854000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789050150.194073:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa83dbbb00) 00010000:00010000:3.0:1789050150.194077:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050150.194085:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1a00/0x3b8ec5973df58454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e3b expref: 5 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050150.194120:0:6507:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8baab7854000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789050150.194132:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050150.194134:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050150.194136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050150.194464:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bbaf27a-e110-4dde-9d4b-6a899944aea0+3:2402:x1875954704172416:12345-192.168.203.42@tcp:39:umount.0 Request processed in 904us (1082us total) trans 4294967536 rc 0/0 00000100:00100000:1.0:1789050150.194475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 259 00000100:00100000:1.0:1789050150.200978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050150.201069:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172544 00000100:00100000:0.0:1789050150.201083:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172544 00000100:00100000:0.0:1789050150.201175:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 260 00000100:00100000:0.0:1789050150.201188:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+5:2402:x1875954704172544:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:0.0:1789050150.201240:0:13807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df574a9 00000100:00080000:0.0:1789050150.201251:0:13807:0:(import.c:65:import_set_state_nolock()) ffff8ba98274a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789050150.201290:0:13807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789050150.201496:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bbaf27a-e110-4dde-9d4b-6a899944aea0+3:2402:x1875954704172544:12345-192.168.203.42@tcp:39:umount.0 Request processed in 311us (567us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789050150.201504:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 260 00010000:00010000:1.0:1789050150.201784:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050150.201848:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050150.237514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050150.237640:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172800 00000100:00100000:2.0:1789050150.237656:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172800 00000100:00100000:2.0:1789050150.237735:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 391 00000100:00100000:2.0:1789050150.237748:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+7:2402:x1875954704172800:12345-192.168.203.42@tcp:251:umount.0 00000020:00000080:2.0:1789050150.237810:0:6510:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df572b1 00000020:00010000:2.0:1789050150.237821:0:6510:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8ba98274e000: total 0 00000100:00080000:2.0:1789050150.237826:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8ba98274d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789050150.238063:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b05a98b1-94f7-4bce-a081-3983ea0fdaeb+3:2402:x1875954704172800:12345-192.168.203.42@tcp:251:umount.0 Request processed in 316us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050150.238072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 391 00000020:00010000:1.0:1789050150.238670:0:8449:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8ba98274e000: total 0 00010000:00010000:1.0:1789050150.238757:0:8449:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8ba98274e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789050150.238802:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d6200/0x3b8ec5973df57440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad396699c expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050150.238822:0:8449:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8ba98274e000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789050150.239080:0:8449:0:(genops.c:885:class_export_put()) final put ffff8ba98274e000/b05a98b1-94f7-4bce-a081-3983ea0fdaeb 00010000:00010000:1.0:1789050150.239147:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050150.239178:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050150.239180:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789050150.244511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274e000/b05a98b1-94f7-4bce-a081-3983ea0fdaeb for MGS 00000020:00000080:3.0:1789050150.246729:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274d000 for MGS 00000100:00100000:2.0:1789050151.018227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050151.018261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714694784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050151.018368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.018906:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050151.018918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714694912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050151.018972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.019019:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694784 00000100:00100000:0.0:1789050151.019030:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694784 00000100:00100000:0.0:1789050151.019094:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714694912 00000100:00100000:0.0:1789050151.019097:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714694912 00000100:00100000:0.0:1789050151.019119:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789050151.019129:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714694784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789050151.019165:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050151.019229:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714694784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.019236:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789050151.019258:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789050151.019264:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714694912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050151.019274:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789050151.019321:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714694912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.019327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789050151.019346:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050151.019386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714694912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050151.019423:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714694784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789050151.083838:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050151.529410:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050151.529441:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714695040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050151.529539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050151.529706:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695040 00000100:00100000:1.0:1789050151.529718:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695040 00000100:00100000:1.0:1789050151.529802:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789050151.529816:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714695040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050151.529867:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789050151.529930:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714695040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050151.529969:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789050151.530017:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714695040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789050151.530117:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050151.532374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714695168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050151.532462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.532543:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695168 00000100:00100000:0.0:1789050151.532551:0:10154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695168 00000100:00100000:0.0:1789050151.532617:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789050151.532628:0:10154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714695168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789050151.532658:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789050151.532723:0:10154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714695168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.532731:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789050151.532756:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050151.532796:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714695168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050151.534371:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714695296:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.534467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.534516:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714695808:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.534544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.534569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714696320:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.534597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.534626:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789050151.534633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714695680:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.534655:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.534674:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714696192:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.534706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.534740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695808 00000100:00100000:0.0:1789050151.534748:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695808 00000100:00100000:0.0:1789050151.534801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789050151.534812:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714695808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.534977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695296 00000100:00100000:2.0:1789050151.534984:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695296 00000100:00100000:0.0:1789050151.535022:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714695808:12345-0@lo:400:kworker.0 Request processed in 211us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.535029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789050151.535036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789050151.535042:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714695296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535068:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696320 00000100:00100000:0.0:1789050151.535075:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696320 00000100:00100000:2.0:1789050151.535086:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8839590-fd25-4606-bad2-917c49937107+24:3645:x1875954714695296:12345-0@lo:400:kworker.0 Request processed in 48us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.535094:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789050151.535256:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695680 00000100:00100000:0.0:1789050151.535261:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695680 00000100:00100000:0.0:1789050151.535290:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696192 00000100:00100000:0.0:1789050151.535293:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696192 00000100:00100000:0.0:1789050151.535317:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789050151.535323:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714696320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535359:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875954714696320:12345-0@lo:400:kworker.0 Request processed in 36us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.535383:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789050151.535396:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789050151.535401:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714695680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535433:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714695680:12345-0@lo:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.535439:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789050151.535449:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789050151.535455:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714696192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535480:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714696192:12345-0@lo:400:kworker.0 Request processed in 26us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.535486:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789050151.535528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714695552:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535558:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.535582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714696064:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.535620:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789050151.535627:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714695424:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535649:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.535665:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714695936:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050151.535723:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695552 00000100:00100000:0.0:1789050151.535727:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695552 00000100:00100000:0.0:1789050151.535750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789050151.535756:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714695552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.535795:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714695552:12345-0@lo:400:kworker.0 Request processed in 40us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.535802:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789050151.535826:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696064 00000100:00100000:2.0:1789050151.535832:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696064 00000100:00100000:2.0:1789050151.535864:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695424 00000100:00100000:2.0:1789050151.535867:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695424 00000100:00100000:2.0:1789050151.535895:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714695936 00000100:00100000:2.0:1789050151.535898:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714695936 00000100:00100000:2.0:1789050151.535918:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789050151.535925:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714696064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.535991:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714696064:12345-0@lo:400:kworker.0 Request processed in 66us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.535997:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789050151.536012:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789050151.536020:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714695424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.536051:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714695424:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.536056:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789050151.536082:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789050151.536090:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714695936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.536118:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714695936:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.536124:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:2.0:1789050151.537213:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050151.537221:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050151.537358:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714695680:0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.537379:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714696192:0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.537391:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714695296:0@lo:400:kworker.0 00000100:00100000:2.0:1789050151.537403:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714695808:0@lo:400:kworker.0 00010000:00080000:2.0:1789050151.537419:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983f2d500 x1875954714696320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050151.537449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875954714696320:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.538030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714695424:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.538046:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714695936:0@lo:400:kworker.0 00000100:00100000:0.0:1789050151.538058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714695552:0@lo:400:kworker.0 00010000:00080000:0.0:1789050151.538071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983f2c380 x1875954714696064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050151.538082:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714696064:0@lo:400:kworker.0 00000020:01000004:0.0:1789050151.696273:0:15203:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789050151.717273:0:15203:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789050151.717333:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.717346:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.717353:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.717359:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.717380:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789050151.717385:0:15203:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789050151.717408:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050151.717428:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789050151.717435:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789050151.717928:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789050151.718226:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050151.718233:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718242:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050151.718246:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718254:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050151.718261:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050151.718266:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789050151.718269:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789050151.718271:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789050151.718305:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718311:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050151.718339:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718347:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae778800/0x3b8ec5973df5740f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57416 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718358:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050151.718360:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050151.718361:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050151.718368:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050151.718387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714696576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050151.718471:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050151.718537:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696576 00000100:00100000:1.0:1789050151.718544:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696576 00000100:00100000:1.0:1789050151.718589:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050151.718599:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+24:3647:x1875954714696576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050151.718612:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050151.718624:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602e00/0x3b8ec5973df57416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df5740f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050151.718635:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050151.718666:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+23:3647:x1875954714696576:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050151.718673:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050151.718722:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714696576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050151.718868:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714696448:0@lo:39:umount.0 00000100:00100000:3.0:1789050151.718899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050151.718986:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696448 00000100:00100000:1.0:1789050151.718990:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696448 00000100:00100000:1.0:1789050151.719107:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789050151.719116:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875954714696448:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789050151.719140:0:13807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f7e 00000100:00080000:1.0:1789050151.719148:0:13807:0:(import.c:65:import_set_state_nolock()) ffff8baab42bd800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789050151.719208:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875954714696448:12345-0@lo:39:umount.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050151.719215:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:1.0:1789050151.719221:0:13807:0:(genops.c:885:class_export_put()) final put ffff8baab42bb000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789050151.719263:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789050151.720146:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789050151.720166:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714696448:0@lo:39:umount.0 00000100:00080000:2.0:1789050151.720229:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050151.720233:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050151.720239:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789050151.721196:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721209:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721217:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721225:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721247:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050151.721253:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721260:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721267:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721273:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721306:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050151.721313:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721319:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721325:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721332:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721342:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789050151.721347:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721353:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721359:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721365:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.721371:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789050151.721374:0:15203:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789050151.721410:0:15203:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789050151.721414:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789050151.721418:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050151.721424:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:2.0:1789050151.721429:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8ba98274b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050151.721436:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8baaae728800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050151.721440:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8baab4e22800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050151.721444:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8baabd168000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789050151.721452:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8baab7854000 2bbaf27a-e110-4dde-9d4b-6a899944aea0 192.168.203.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050151.721457:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8baab4f86800 615c64c6-0403-4edc-8952-4a12704f5533 192.168.203.42@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967530 stale:0 00000020:00080000:2.0:1789050151.721462:0:15203:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8baa87724d40) has exports, disconnecting them 00000020:00080000:2.0:1789050151.721466:0:15203:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ba98274b000), last request at 1789050151 00000020:00000080:2.0:1789050151.721474:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57295 00000100:00080000:2.0:1789050151.721490:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8ba98274e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789050151.721536:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba98274b000): rc 0 00000020:00000080:2.0:1789050151.721538:0:15203:0:(genops.c:885:class_export_put()) final put ffff8ba98274b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789050151.721544:0:15203:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8baaae728800), last request at 1789050151 00000020:00000080:2.0:1789050151.721547:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5716f 00000100:00080000:2.0:1789050151.721551:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baaae729000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789050151.721557:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baaae728800): rc 0 00000020:00000080:2.0:1789050151.721559:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaae728800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789050151.721563:0:15203:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8baab4e22800), last request at 1789049928 00000020:00000080:2.0:1789050151.721565:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57065 00000100:00080000:2.0:1789050151.721568:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baab4e27800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789050151.721574:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baab4e22800): rc 0 00000020:00000080:2.0:1789050151.721575:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab4e22800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789050151.721587:0:15203:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8baabd168000), last request at 1789049928 00000020:00000080:2.0:1789050151.721590:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57026 00000100:00080000:2.0:1789050151.721594:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baabd16f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050151.721601:0:15203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967536 00000020:00080000:2.0:1789050151.721669:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baabd168000): rc 0 00000004:00000080:2.0:1789050151.721675:0:15203:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaeaec85afae0 00000100:00080000:2.0:1789050151.721701:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789050151.721705:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789050151.722623:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789050151.722653:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baaae566000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789050151.722736:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789050151.722744:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050151.722755:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a4c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789050151.722759:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050151.722770:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050151.722778:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050151.722784:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050151.722787:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789050151.722790:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789050151.722860:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050151.722867:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.722874:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050151.722878:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.722884:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050151.722890:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050151.722894:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050151.722897:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789050151.722899:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789050151.722923:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.722930:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050151.722972:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.722992:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80030e00/0x3b8ec5973df57344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5734b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723006:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050151.723011:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723017:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050151.723020:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723027:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050151.723033:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050151.723038:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789050151.723040:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789050151.723042:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789050151.723056:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723062:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050151.723074:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723080:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80030800/0x3b8ec5973df57685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5768c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723101:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050151.723104:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723110:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050151.723113:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723120:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050151.723126:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050151.723130:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050151.723132:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789050151.723134:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789050151.723147:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723153:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050151.723161:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723167:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2176c00/0x3b8ec5973df56edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56ee4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723178:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050151.723180:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050151.723185:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.723190:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050151.723195:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050151.723200:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050151.723203:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050151.723210:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4c00/0x3b8ec5973df5741d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57424 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050151.723220:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050151.723222:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050151.723224:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789050151.723236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab42bb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789050151.723310:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789050151.723335:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae728800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789050151.723359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4e22800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789050151.723386:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab42bd800 for lustre-MDT0000 00000020:00000080:3.0:1789050151.723393:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274e800 for lustre-MDT0000 00000020:00000080:3.0:1789050151.723397:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baaae729000 for lustre-MDT0000 00000020:00000080:3.0:1789050151.723403:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab4e27800 for lustre-MDT0000 00000100:00080000:3.0:1789050151.723466:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789050151.723470:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789050151.723480:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789050151.723536:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789050151.724134:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baab7756000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789050151.724145:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789050151.724148:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789050151.724162:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789050151.724227:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789050151.724239:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8ba982283800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789050151.724623:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8baa87724d40) has no exports 00000100:00100000:3.0:1789050151.724775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714696832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050151.725502:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714697216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050151.726049:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714697088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050151.726165:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050151.726228:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697216 00000100:00100000:2.0:1789050151.726235:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697216 00000100:00100000:2.0:1789050151.726281:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050151.726289:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+23:3646:x1875954714697216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050151.726302:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050151.726317:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603000/0x3b8ec5973df57424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df5741d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.726331:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050151.726364:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8839590-fd25-4606-bad2-917c49937107+22:3646:x1875954714697216:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.726371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050151.726412:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714697216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050151.726991:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714696960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050151.727032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050151.727114:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696960 00000100:00100000:2.0:1789050151.727119:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696960 00000100:00100000:2.0:1789050151.727182:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050151.727190:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+22:3644:x1875954714696960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050151.727216:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050151.727228:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042800/0x3b8ec5973df5768c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57685 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050151.727239:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050151.727271:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8839590-fd25-4606-bad2-917c49937107+21:3644:x1875954714696960:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.727278:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050151.727343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050151.727600:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:3644:1875954714696960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050151.730362:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697088 00000100:00100000:0.0:1789050151.730377:0:7460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697088 00000100:00100000:0.0:1789050151.730448:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050151.730458:0:7460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+21:3645:x1875954714697088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050151.730473:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050151.731370:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df56ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df56edd expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050151.731394:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050151.731931:0:7460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8839590-fd25-4606-bad2-917c49937107+20:3645:x1875954714697088:12345-0@lo:103:ldlm_bl.0 Request processed in 1472us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050151.731971:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789050151.736184:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714696704:0@lo:39:umount.0 00000100:00100000:3.0:1789050151.736272:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050151.736611:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714697344:0@lo:9:umount.0 00000100:00100000:3.0:1789050151.736641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050151.736669:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714697472:0@lo:9:umount.0 00000100:00100000:3.0:1789050151.736744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050151.736807:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697344 00000100:00100000:3.0:1789050151.736816:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697344 00000100:00100000:3.0:1789050151.736854:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697472 00000100:00100000:3.0:1789050151.736857:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697472 00000100:00100000:3.0:1789050151.736875:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789050151.736981:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696704 00000100:00100000:2.0:1789050151.736987:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696704 00000100:00100000:2.0:1789050151.737023:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789050151.737031:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875954714696704:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789050151.737066:0:13086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df570c0 00000100:00080000:2.0:1789050151.737076:0:13086:0:(import.c:65:import_set_state_nolock()) ffff8baab4e24800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050151.737100:0:13086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789050151.737261:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1875954714696704:12345-0@lo:39:umount.0 Request processed in 230us (988us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789050151.737269:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789050151.737297:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789050151.737305:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875954714697472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789050151.737320:0:8433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57375 00000100:00080000:2.0:1789050151.737325:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ba98276f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050151.737365:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789050151.739055:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1875954714697472:12345-0@lo:9:umount.0 Request processed in 1743us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050151.739070:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1789050151.739124:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050151.739146:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050151.740102:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875954714697344:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789050151.740150:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57210 00000100:00080000:3.0:1789050151.740160:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8baaae72e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050151.740232:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1789050151.740321:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050151.740584:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050151.740590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714697088:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789050151.743068:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaae566000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789050151.743086:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714696704:0@lo:39:umount.0 00000100:00100000:3.0:1789050151.743101:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1875954714697344:12345-0@lo:9:umount.0 Request processed in 6215us (6455us total) trans 0 rc 0/0 00000100:00080000:2.0:1789050151.743106:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab7756000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789050151.743114:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000004:00080000:2.0:1789050151.743122:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050151.743125:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050151.743129:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714697344:0@lo:9:umount.0 00000100:00080000:2.0:1789050151.743142:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba982283800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789050151.743179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714696832 00000100:00100000:3.0:1789050151.743429:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714696832 00000100:00100000:3.0:1789050151.743489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050151.743498:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+20:3647:x1875954714696832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050151.743512:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050151.743529:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043600/0x3b8ec5973df5734b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57344 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050151.743546:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050151.743584:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8839590-fd25-4606-bad2-917c49937107+19:3647:x1875954714696832:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050151.743591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789050151.743617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8839590-fd25-4606-bad2-917c49937107:3647:1875954714696832:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1789050151.743622:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050151.743901:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050151.743907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714697472:0@lo:9:umount.0 00000020:00080000:0.0:1789050151.745406:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8baa87724d40) has no exports 00000020:00000080:0.0:1789050151.800602:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f38 00000020:00000080:0.0:1789050151.800623:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab4113000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789050151.800652:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789050151.800811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4113000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789050151.800844:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050151.800855:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789050151.800860:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8baa82c14d40) has no exports 00000020:00000080:1.0:1789050151.801996:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f31 00000020:00000080:1.0:1789050151.802008:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab40bc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789050151.802090:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050151.802101:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789050151.802104:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab0e48000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789050151.802107:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab0e48000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789050151.802114:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789050151.802495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab40bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1789050152.106191:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050152.554699:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789050153.130433:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050154.089293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714697600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050154.089404:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050154.089580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697600 00000100:00100000:1.0:1789050154.089593:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697600 00000100:00100000:1.0:1789050154.089658:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789050154.089668:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875954714697600:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1789050154.089704:0:6523:0:(tgt_handler.c:811:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789050154.089766:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875954714697600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (361us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789050154.089775:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:02020000:3.0:1789050154.089852:0:3647:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1789050154.095980:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789050154.095991:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789050154.096020:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789050154.116820:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050154.116838:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 151 00000100:00080000:3.0:1789050154.116859:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8baa90bd1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050154.116929:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae795880 x1875954714697728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050154.119514:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714697728:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789050154.119627:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050154.119792:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697728 00000100:00100000:3.0:1789050154.119815:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697728 00000100:00100000:3.0:1789050154.119869:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789050154.124452:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714697728:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1789050154.124501:0:6524:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789050154.143606:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714697728:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 23712us (23963us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789050154.143637:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1789050154.143763:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050154.143771:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789050154.143775:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714697728:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1789050154.153791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789050154.606025:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789050154.606039:0:9512:0:(genops.c:885:class_export_put()) final put ffff8ba98276c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789050154.607098:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:0.0:1789050154.607105:0:9512:0:(genops.c:885:class_export_put()) final put ffff8baaae9e9800/615c64c6-0403-4edc-8952-4a12704f5533 00000001:00100000:2.0:1789050154.609330:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789050154.609339:0:6497:0:(genops.c:885:class_export_put()) final put ffff8baabd168000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789050154.609666:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789050154.609695:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1789050154.609701:0:7450:0:(genops.c:885:class_export_put()) final put ffff8baaae51f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050154.610509:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98276c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789050154.610584:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98276f800 for lustre-OST0001 00000001:00100000:1.0:1789050154.615002:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00080000:1.0:1789050154.615020:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1789050154.615027:0:7450:0:(genops.c:885:class_export_put()) final put ffff8ba98274c000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00100000:1.0:1789050154.615038:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000001:00080000:1.0:1789050154.615042:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1789050154.615044:0:7450:0:(genops.c:885:class_export_put()) final put ffff8baab7867800/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:3.0:1789050154.615739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae9e9800/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-OST0001 00000020:00000080:3.0:1789050154.615839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd168000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789050154.615876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae51f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789050154.615907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274c000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 for lustre-MDT0001 00000020:00000080:3.0:1789050154.615959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7867800/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-MDT0001 00000020:00000080:3.0:1789050154.616002:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baaae9ed000 for lustre-OST0001 00000020:00000080:3.0:1789050154.616007:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baabd16f000 for lustre-MDT0000 00000020:00000080:3.0:1789050154.616012:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab4e24800 for lustre-MDT0001 00000020:00000080:3.0:1789050154.616016:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98274a000 for lustre-MDT0001 00000020:00000080:3.0:1789050154.616020:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab7867000 for lustre-MDT0001 00000001:00100000:2.0:1789050154.616556:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00080000:2.0:1789050154.616569:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000020:00000080:2.0:1789050154.616573:0:6497:0:(genops.c:885:class_export_put()) final put ffff8baab7854000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 00000001:00100000:2.0:1789050154.616630:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000001:00080000:2.0:1789050154.616636:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967535 is committed 00000020:00000080:2.0:1789050154.616645:0:6497:0:(genops.c:885:class_export_put()) final put ffff8baab4f86800/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:1.0:1789050154.617934:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7854000/2bbaf27a-e110-4dde-9d4b-6a899944aea0 for lustre-MDT0000 00000020:00000080:1.0:1789050154.619451:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab7852800 for lustre-MDT0000 00000001:00100000:0.0:1789050154.624028:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789050154.624043:0:8427:0:(genops.c:885:class_export_put()) final put ffff8baaae72a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050154.624185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4f86800/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-MDT0000 00000020:00000080:3.0:1789050154.624262:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab7866000 for lustre-MDT0000 00000001:00100000:0.0:1789050154.627530:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:0.0:1789050154.627543:0:8427:0:(genops.c:885:class_export_put()) final put ffff8baa91f2c000/615c64c6-0403-4edc-8952-4a12704f5533 00000020:00000080:1.0:1789050154.631239:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae72a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789050154.631436:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baaae72e000 for lustre-OST0000 00000020:00000080:1.0:1789050154.632153:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa91f2c000/615c64c6-0403-4edc-8952-4a12704f5533 for lustre-OST0000 00000020:00000080:1.0:1789050154.635706:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baa91f2c800 for lustre-OST0000 00010000:00010000:2.0:1789050155.178557:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050156.137778:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714697856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050156.138013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.138180:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697856 00000100:00100000:3.0:1789050156.138204:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697856 00000100:00100000:3.0:1789050156.138288:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789050156.138300:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714697856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050156.138345:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789050156.138412:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714697856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050156.138420:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1789050156.138544:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050156.138643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714697856:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789050156.201826:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050156.651611:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714697984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050156.651716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789050156.652059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789050156.652064:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789050156.652069:0:37:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050156.652076:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 376 00000100:00080000:0.0:1789050156.652082:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050156.652094:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8baa90bd1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050156.652191:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714698112:0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.652235:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.652281:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698112 00000100:00100000:3.0:1789050156.652290:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698112 00000100:00100000:3.0:1789050156.652341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789050156.652351:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:3646:x1875954714698112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.652405:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaac544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8839590-fd25-4606-bad2-917c49937107+19:3646:x1875954714698112:12345-0@lo:400:kworker.0 Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050156.652414:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789050156.652473:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714698112:0@lo:400:kworker.0 00000100:00100000:0.0:1789050156.652648:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a2d80 x1875954714698240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050156.652793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714698624:0@lo:400:kworker.0 00000100:00100000:1.0:1789050156.652830:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050156.652860:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050156.652866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714698496:0@lo:400:kworker.0 00000100:00100000:1.0:1789050156.652889:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050156.652914:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714698240:0@lo:38:kworker.0 00000100:00100000:1.0:1789050156.652966:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.653041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714698752:0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.653068:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.653097:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789050156.653111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714698368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.653134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.653150:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714698880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.653170:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050156.653198:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698624 00000100:00100000:3.0:1789050156.653215:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698624 00000100:00100000:3.0:1789050156.653259:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698496 00000100:00100000:3.0:1789050156.653262:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698496 00000100:00100000:3.0:1789050156.653272:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698752 00000100:00100000:3.0:1789050156.653274:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698752 00000100:00100000:3.0:1789050156.653281:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698368 00000100:00100000:3.0:1789050156.653283:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698368 00000100:00100000:3.0:1789050156.653291:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698880 00000100:00100000:3.0:1789050156.653293:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698880 00000100:00100000:3.0:1789050156.653309:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789050156.653315:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714698624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.653355:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714698624:12345-0@lo:400:kworker.0 Request processed in 40us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050156.653362:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789050156.653386:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789050156.653395:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714698880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050156.653428:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714698880:12345-0@lo:400:kworker.0 Request processed in 37us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050156.653434:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789050156.653447:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789050156.653451:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875954714698496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789050156.653457:0:10357:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789050156.653484:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875954714698496:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050156.653490:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789050156.653501:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789050156.653505:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875954714698752:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789050156.653510:0:10357:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789050156.653543:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875954714698752:12345-0@lo:400:kworker.0 Request processed in 36us (473us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789050156.653694:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714697984 00000100:00100000:2.0:1789050156.653701:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714697984 00000100:00100000:2.0:1789050156.653744:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789050156.653754:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714697984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050156.653770:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789050156.653778:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1875954714698368:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789050156.653784:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000020:00080000:0.0:1789050156.653784:0:14070:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789050156.653827:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1875954714698368:12345-0@lo:400:kworker.0 Request processed in 48us (691us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789050156.653835:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789050156.653840:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714697984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050156.653849:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789050156.653869:0:13086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714698240 00000100:00100000:0.0:1789050156.653873:0:13086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714698240 00000100:00080000:2.0:1789050156.653883:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050156.653890:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050156.653902:0:13086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789050156.653908:0:13086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875954714698240:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789050156.653932:0:13086:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1789050156.653986:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789050156.653992:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8baab4e26800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789050156.653997:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789050156.654083:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050156.654087:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789050156.654091:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789050156.654095:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050156.654100:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:1.0:1789050156.654108:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ba981a0c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050156.654144:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983d98a80 x1875954714699008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050156.654166:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714698496:0@lo:400:kworker.0 00010000:00080000:1.0:1789050156.654181:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a1880 x1875954714698624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050156.654191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714698624:0@lo:400:kworker.0 00000100:00100000:1.0:1789050156.654209:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714697984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050156.654236:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714699008:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789050156.654268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050156.654301:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699008 00000100:00100000:1.0:1789050156.654312:0:14070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699008 00000100:00100000:1.0:1789050156.654336:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789050156.654341:0:14070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875954714699008:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789050156.654349:0:14070:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789050156.654380:0:14070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875954714699008:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 39us (112us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050156.654386:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789050156.654413:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050156.654419:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789050156.654422:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714699008:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789050156.654692:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1789050156.666217:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8baab4e26800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050156.666231:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 151 00000100:00080000:2.0:1789050156.666257:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8baab4e26800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050156.666314:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2f100 x1875954714699136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050156.666342:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714698368:0@lo:400:kworker.0 00010000:00080000:2.0:1789050156.666383:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba981b01880 x1875954714698880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050156.666396:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714698880:0@lo:400:kworker.0 00000100:00080000:2.0:1789050156.666414:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789050156.666438:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789050156.666443:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789050156.666447:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050156.666451:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1789050156.666457:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ba983176800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050156.666472:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2f800 x1875954714699264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050156.666483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714698752:0@lo:400:kworker.0 00000100:00100000:1.0:1789050156.667228:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714699136:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789050156.667314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050156.667356:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714699264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789050156.667384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050156.667433:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699136 00000100:00100000:1.0:1789050156.667443:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699136 00000100:00100000:1.0:1789050156.667483:0:13807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699264 00000100:00100000:1.0:1789050156.667486:0:13807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699264 00000100:00100000:1.0:1789050156.667506:0:13807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789050156.667513:0:13807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875954714699136:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789050156.667532:0:13807:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789050156.667734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789050156.667740:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714699264:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789050156.667749:0:6518:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789050156.668215:0:13807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875954714699136:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 699us (899us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050156.668225:0:13807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789050156.668269:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab4e26800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050156.668273:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789050156.668277:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714699136:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789050156.668301:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050156.668305:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789050156.668307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714699264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789050156.668698:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714699264:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 952us (1309us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789050156.668705:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789050156.678223:0:13086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875954714698240:12345-0@lo:38:kworker.0 Request processed in 24301us (25243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789050156.678241:0:13086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1789050156.679484:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050156.679496:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789050156.679501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714698240:0@lo:38:kworker.0 00010000:00010000:0.0:1789050157.225749:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789050157.865187:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baaae53f6c0 - data ffff8baaa95b9bd0/ffff8baab4334800 00000020:01000000:3.0:1789050157.865594:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baa9056c3c0 - data ffff8baaa9566798/ffff8baab40a4c00 00000001:00000004:1.0:1789050157.878152:0:15203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967536 00000100:00080000:0.0:1789050157.929660:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789050157.929668:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789050157.929683:0:15203:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ba98369ca80 x1875954714696704/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789050161 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050157.929710:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789050157.932026:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789050157.932033:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789050157.932051:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789050157.932054:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789050157.932434:0:8627:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789050157.932438:0:8627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789050157.932458:0:8627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789050157.934303:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789050157.934310:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789050157.934363:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789050157.934366:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789050157.935104:0:10096:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789050157.935109:0:10096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1789050157.935118:0:10096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789050157.937062:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f00 00000020:00000080:0.0:1789050157.937075:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789050157.940959:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050157.943663:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f15 00000020:00000080:0.0:1789050157.943676:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789050157.943723:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789050157.943728:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050157.943736:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050157.943740:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8baa87723380) has no exports 00000020:00000080:2.0:1789050157.943910:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789050157.944093:0:15203:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789050157.944112:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5736e 00000020:00000080:0.0:1789050157.944121:0:15203:0:(genops.c:885:class_export_put()) final put ffff8ba98276a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789050157.944142:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789050157.944163:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050157.944176:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789050157.944180:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8baaae6e4d40) has no exports 00000020:00000080:2.0:1789050157.944187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98276a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789050157.944193:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57367 00000020:00000080:0.0:1789050157.944203:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaac621800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789050157.944296:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac621800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789050157.945142:0:15203:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789050157.945149:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789050157.945153:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789050157.945161:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789050157.945165:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789050157.945300:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.945313:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789050157.945320:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57209 00000020:00000080:0.0:1789050157.945329:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab7751000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050157.945440:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba982283800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789050157.945449:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba98276e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050157.945452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98276e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789050157.945459:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789050157.945598:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789050157.945603:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050157.945771:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7751000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789050157.945852:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050157.945856:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8baabd033380) has no exports 00000020:00000080:0.0:1789050157.945862:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57202 00000020:00000080:0.0:1789050157.945867:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baab7752800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789050157.946506:0:15203:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789050157.946511:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789050157.946514:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789050157.946519:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789050157.946521:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789050157.946794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7752800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050157.946972:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.946982:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789050157.946999:0:15203:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789050157.947007:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df570b9 00000020:00000080:0.0:1789050157.947015:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baa85741800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050157.947048:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab7756000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789050157.947056:0:37:0:(genops.c:885:class_export_put()) final put ffff8baab4393800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050157.947058:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4393800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789050157.947063:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789050157.948955:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789050157.948971:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050157.948999:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789050157.949005:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8baabd178000) has no exports 00000020:00000080:0.0:1789050157.949015:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df570b2 00000020:00000080:0.0:1789050157.949024:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaae562800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789050157.949988:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85741800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789050157.950004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae562800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789050157.963276:0:15203:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789050157.963290:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789050157.963295:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789050157.963308:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789050157.963427:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.963449:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789050157.963486:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.963490:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789050157.963497:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789050157.963502:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789050157.963525:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789050157.963681:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f1c 00000020:00000080:0.0:1789050157.963691:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc6000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789050157.963776:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baaae566000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789050157.963784:0:37:0:(genops.c:885:class_export_put()) final put ffff8baaae563000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050157.963787:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae563000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789050157.963795:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789050157.963997:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789050157.964003:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050157.964009:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050157.964014:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8baa87720000) has no exports 00000020:00000080:0.0:1789050157.964038:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.964041:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789050157.964046:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f23 00000020:00000080:0.0:1789050157.964050:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789050157.964074:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789050157.964141:0:37:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc1000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789050157.964144:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789050157.964149:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789050157.964323:0:15203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baaac606800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789050157.964327:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac606800 3 00000020:01000004:0.0:1789050157.964332:0:15203:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8baaac606800 from lustre-MDT0000 00000020:00000080:0.0:1789050157.964372:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050157.964377:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789050157.964381:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa7dc3000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789050157.964384:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789050157.964407:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789050157.964454:0:15203:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789050157.964460:0:15203:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789050157.964464:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789050157.964466:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050157.964470:0:15203:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789050157.964477:0:15203:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8baab0e94000 b8839590-fd25-4606-bad2-917c49937107 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789050157.964483:0:15203:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8baa857a99c0) has exports, disconnecting them 00000020:00080000:0.0:1789050157.964488:0:15203:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8baab0e94000), last request at 1789049910 00000020:00000080:0.0:1789050157.964507:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56ec1 00000020:00010000:0.0:1789050157.964512:0:15203:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8baab0e94000: total 1 00000100:00080000:0.0:1789050157.964517:0:15203:0:(import.c:65:import_set_state_nolock()) ffff8baab0e97000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789050157.964539:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baab0e94000): rc 0 00000020:00080000:0.0:1789050157.964544:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8baa857a99c0) has no exports 00000020:00010000:3.0:1789050157.964586:0:8449:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8baab0e94000: total 1 00010000:00010000:3.0:1789050157.964667:0:8449:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8baab0e94000, canceled 0 locks, left on hash table 13. 00000020:00000080:2.0:1789050157.964691:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa7dc2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789050157.964708:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae779200/0x3b8ec5973df573de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df573d7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964737:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778e00/0x3b8ec5973df573ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df573e5 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964749:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a5400/0x3b8ec5973df573fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df573f3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964760:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae5a5600/0x3b8ec5973df57408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57401 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964786:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030600/0x3b8ec5973df56fbd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df56fb6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050157.964806:0:6510:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8baab9986800:6510] 0 exiting: rc = 1 00010000:00010000:3.0:1789050157.964813:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80031c00/0x3b8ec5973df56fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df56fc4 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964846:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2042c00/0x3b8ec5973df572f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df572f0 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964859:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778a00/0x3b8ec5973df57662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df5765b expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964868:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae778c00/0x3b8ec5973df573d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df573c9 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964876:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baac2043400/0x3b8ec5973df5767e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57677 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964887:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602a00/0x3b8ec5973df57432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df5742b expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964910:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae779600/0x3b8ec5973df573c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df573bb expref: 3 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964923:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa80030200/0x3b8ec5973df57670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3b8ec5973df57669 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050157.964965:0:8449:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8baab0e94000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789050157.964988:0:8449:0:(genops.c:885:class_export_put()) final put ffff8baab0e94000/b8839590-fd25-4606-bad2-917c49937107 00010000:00010000:3.0:1789050157.965012:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050157.965016:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050157.965019:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050157.965034:0:6513:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8baa8631fe00:6513] 2 exiting: rc = 0 00000100:00100000:3.0:1789050157.965081:0:6512:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8baa82dabc00:6512] 1 exiting: rc = 0 00000100:00100000:0.0:1789050157.965390:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965403:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965413:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965424:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965437:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965601:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965691:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965702:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965709:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965716:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965724:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965736:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965745:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965753:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965759:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965767:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965775:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965784:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965809:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965822:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789050157.965839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab0e94000/b8839590-fd25-4606-bad2-917c49937107 for MGS 00000100:00100000:0.0:1789050157.965889:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965898:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965905:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965918:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965926:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965932:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965958:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965965:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965972:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965979:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965985:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965992:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.965998:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966004:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966010:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966016:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966026:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966037:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966047:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966057:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966063:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966068:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966073:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966145:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966162:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966174:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966186:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966257:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966266:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966272:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966279:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966285:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966291:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966307:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966312:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966318:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966324:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966330:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966342:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966352:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966364:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966376:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966389:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050157.966399:0:15203:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789050157.966594:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab0e97000 for MGS 00000020:01000000:0.0:1789050157.970738:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ba981bb3420 - data ffff8ba981c4ae58/ffff8ba98344f800 00000020:01000000:0.0:1789050157.970903:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baab11bd3c0 - data ffff8baaa94a0360/ffff8baab0fb7400 00000020:00000080:2.0:1789050157.982924:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56ea5 00000020:00000080:2.0:1789050157.982973:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baa88348800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789050157.983002:0:15203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baaac606800 from MGS, refs=2 00000020:01000004:2.0:1789050157.983006:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac606800 2 00000020:01000004:2.0:1789050157.983010:0:15203:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8baaac606800 from MGS 00000020:00000080:3.0:1789050157.983034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa88348800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789050157.983046:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050157.983060:0:15203:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789050157.983063:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baa861d6000/MGS 00000020:00000080:2.0:1789050157.983066:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa861d6000/MGS for MGS 00000020:01000000:2.0:1789050157.983077:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789050157.983190:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789050157.983206:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050157.983212:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789050157.983221:0:15203:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8baa90bd4800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050157.983243:0:15203:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8baa857acd40) has exports, disconnecting them 00000020:00080000:2.0:1789050157.983248:0:15203:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8baa90bd4800), last request at 1789049910 00000020:00000080:2.0:1789050157.983253:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f70 00000020:00080000:2.0:1789050157.983269:0:15203:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baa90bd4800): rc 0 00000020:00000080:2.0:1789050157.983275:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baa90bd4800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789050157.983379:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa90bd4800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789050157.996588:0:15203:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789050157.996600:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050157.996605:0:15203:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789050157.996850:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050157.997095:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baa90bd3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789050157.997146:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050157.997157:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789050157.997163:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baa90bd6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789050157.997168:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa90bd6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789050157.997185:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789050157.997289:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac606800 1 00000020:00000080:2.0:1789050157.997297:0:15203:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56e97 00000020:00000080:2.0:1789050157.997304:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaa1b9e000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789050157.997321:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789050157.997327:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050157.997332:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789050157.997336:0:15203:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8baa877219c0) has no exports 00000020:00000080:3.0:1789050157.997600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaa1b9e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789050158.061132:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050158.061146:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789050158.061152:0:15203:0:(genops.c:885:class_export_put()) final put ffff8baaac604800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789050158.061157:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac604800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789050158.061169:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789050158.061283:0:15203:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8baaac605800 00000020:02000400:1.0:1789050158.061343:0:15203:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789050158.249069:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050159.274718:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050160.298106:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050161.257712:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050161.257754:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714699392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050161.257853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050161.257933:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699392 00000100:00100000:2.0:1789050161.257969:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699392 00000100:00100000:2.0:1789050161.258093:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789050161.258106:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714699392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050161.258145:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789050161.258200:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714699392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050161.258208:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789050161.258221:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050161.258782:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714699392:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789050161.322517:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789050161.495245:0:15405:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789050161.517201:0:15405:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789050161.517278:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.517297:0:15405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.517305:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.517314:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.517343:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050161.517350:0:15405:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789050161.517382:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050161.517387:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789050161.517394:0:15405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789050161.517402:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8baab4e26800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789050161.517408:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050161.517410:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050161.517414:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789050161.518644:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050161.518661:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.518674:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae779c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050161.518680:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.518691:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050161.518699:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050161.518706:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050161.518709:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789050161.518713:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789050161.518781:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.518789:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050161.519644:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.519658:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae779c00/0x3b8ec5973df573f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df573fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.519675:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050161.519678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050161.519680:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050161.519883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714699520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050161.520377:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050161.522902:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699520 00000100:00100000:0.0:1789050161.522925:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699520 00010000:00010000:2.0:1789050161.523328:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.523350:0:15405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.523360:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.524174:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.524256:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050161.524267:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.524274:0:15405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.524280:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.524287:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527100:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050161.527118:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527134:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789050161.527139:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527151:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050161.527160:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050161.527167:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050161.527171:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789050161.527218:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527241:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050161.527277:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527285:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602800/0x3b8ec5973df57401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df57408 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527305:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050161.527309:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527315:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603400 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789050161.527318:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527325:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050161.527484:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050161.527489:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050161.527492:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789050161.527508:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527513:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050161.527521:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050161.527538:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050161.527540:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050161.527542:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050161.527569:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714699648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050161.527663:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050161.527782:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050161.527796:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714699776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050161.527820:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050161.527860:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699648 00000100:00100000:3.0:1789050161.527868:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699648 00000100:00100000:3.0:1789050161.527904:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699776 00000100:00100000:3.0:1789050161.527908:0:7461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699776 00000100:00100000:3.0:1789050161.527931:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789050161.527965:0:7461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8752cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1875954714699648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789050161.527972:0:7461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050161 with bad export cookie 4291584748300889793 00000100:00100000:0.0:1789050161.529101:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789050161.529115:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875954714699776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789050161.529124:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050161 with bad export cookie 4291584748300889793 00010000:00010000:2.0:1789050161.529303:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789050161.529317:0:15405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df572f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df572f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050161.529325:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050161.529420:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875954714699776:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (1597us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789050161.529430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 10000000:01000000:2.0:1789050161.529482:0:15405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789050161.529496:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529505:0:15405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529511:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529533:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529562:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050161.529568:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529575:0:15405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529581:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529587:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.529603:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789050161.529607:0:15405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789050161.529610:0:15405:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789050161.529655:0:15405:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789050161.529661:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789050161.529666:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050161.529673:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789050161.529682:0:15405:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8ba982748800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050161.529689:0:15405:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8baaae729800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050161.529695:0:15405:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8baa82c119c0) has exports, disconnecting them 00000020:00080000:2.0:1789050161.529700:0:15405:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ba982748800), last request at 1789050156 00000020:00000080:2.0:1789050161.529708:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df572a3 00000100:00080000:1.0:1789050161.529711:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050161.529718:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8baab0e92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789050161.529725:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789050161.529736:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8ba982749000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789050161.529773:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050161.529783:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.529795:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae778400 already unused, calling callback (ffffffffc1287c20) 00000020:00080000:2.0:1789050161.529801:0:15405:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba982748800): rc 0 00000020:00000080:2.0:1789050161.529805:0:15405:0:(genops.c:885:class_export_put()) final put ffff8ba982748800/lustre-MDT0001-lwp-OST0001_UUID 10000000:00010000:0.0:1789050161.529811:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789050161.529817:0:15405:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8baaae729800), last request at 1789050156 00000020:00000080:2.0:1789050161.529829:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5717d 00010000:00010000:0.0:1789050161.529833:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789050161.529837:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8baaae72d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789050161.529844:0:15405:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baaae729800): rc 0 00000020:00000080:2.0:1789050161.529846:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baaae729800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789050161.529853:0:15405:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaeaec19afae0 10000000:00010000:0.0:1789050161.529862:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050161.529871:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789050161.529874:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00080000:2.0:1789050161.529876:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:0.0:1789050161.529879:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1789050161.529888:0:15405:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8ba983d9bb80 x1875954714697600/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789050170 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050161.529905:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1789050161.532046:0:15405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789050161.533174:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789050161.535147:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789050161.535156:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1789050161.535179:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789050161.535248:0:15405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789050161.535278:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8ba981a08800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789050161.535299:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789050161.535302:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1789050161.535309:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789050161.535373:0:15405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789050161.535385:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8baab77fc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789050161.535409:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8baa82c119c0) has no exports 00010000:00010000:2.0:1789050161.535447:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050161.535455:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.535477:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6a00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050161.535481:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.535491:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050161.535497:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050161.535502:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050161.535505:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789050161.535508:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1789050161.536397:0:7461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8752cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1875954714699648:12345-0@lo:103:ldlm_bl.0 Request processed in 8427us (8737us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050161.536409:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00000080:3.0:1789050161.536451:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982748800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789050161.536501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaae729800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789050161.536523:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba982749000 for lustre-MDT0001 00000020:00000080:3.0:1789050161.536528:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baaae72d000 for lustre-MDT0001 00000100:00100000:3.0:1789050161.536546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714697600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050161.538056:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789050161.538066:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1875954714699520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789050161.538091:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050161 with bad export cookie 4291584748300889793 00000100:00100000:3.0:1789050161.538171:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1875954714699520:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (17794us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050161.538178:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789050161.538259:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050161.549187:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.142@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789050161.549194:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789050161.549208:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba981b00000 x1875954714699520/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050177 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050161.549237:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baaae795c00 x1875954714699648/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050177 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050161.549268:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baaae795f80 x1875954714699776/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050177 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789050161.549278:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789050161.549281:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789050161.549282:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1789050161.549383:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.549395:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050161.549434:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.549443:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae778400/0x3b8ec5973df57677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df5767e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050161.549465:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050161.549468:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050161.549470:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050161.549503:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:0:1875954714700160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050161.550007:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050161.552713:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.552729:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050161.552761:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.552771:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df56fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3b8ec5973df56fcb expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050161.552794:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050161.552797:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050161.552801:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050161.552853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714699904:0@lo:9:umount.0 00000100:00100000:0.0:1789050161.552998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050161.553053:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714700032:0@lo:9:umount.0 00000100:00100000:0.0:1789050161.553082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050161.553137:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714699904 00000100:00100000:0.0:1789050161.553147:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714699904 00000100:00100000:0.0:1789050161.553203:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714700032 00000100:00100000:0.0:1789050161.553219:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714700032 00000100:00100000:0.0:1789050161.553264:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789050161.553275:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875954714699904:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789050161.553310:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df571d8 00000100:00100000:2.0:1789050161.553317:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789050161.553323:0:8629:0:(import.c:65:import_set_state_nolock()) ffff8baa85740800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789050161.553350:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875954714700032:12345-0@lo:9:umount.0 00000001:00000004:0.0:1789050161.553376:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000020:00000080:2.0:1789050161.553612:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57328 00000100:00080000:2.0:1789050161.553783:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8baab77f9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050161.553833:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789050161.554037:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3643:x1875954714700032:12345-0@lo:9:umount.0 Request processed in 707us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050161.554047:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789050161.554096:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3643:x1875954714699904:12345-0@lo:9:umount.0 Request processed in 819us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050161.554106:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789050161.554140:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050161.554484:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba981a08800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050161.554500:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050161.554502:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050161.554506:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714699904:0@lo:9:umount.0 00000100:00080000:2.0:1789050161.554528:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab77fc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050161.554536:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050161.554537:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050161.554540:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714700032:0@lo:9:umount.0 00000100:00100000:2.0:1789050161.554576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050161.554587:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8839590-fd25-4606-bad2-917c49937107:0:1875954714700288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050161.554601:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050161.554607:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050161.561789:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8baab0e92000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789050161.561826:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8839590-fd25-4606-bad2-917c49937107:3645:1875954714699520:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789050161.562205:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8baab0e92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050161.565042:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:1.0:1789050161.565068:0:3646:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import ffff8baab0e92000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050161.565161:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983d9a680 x1875954714700416/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050161.565213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714699648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050161.565599:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714700416:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1789050161.565674:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875954714700416 offset 0 length 520: 4 00000100:00100000:1.0:1789050161.565717:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8839590-fd25-4606-bad2-917c49937107:3646:1875954714699776:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789050161.580604:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8baa82c119c0) has no exports 00000020:01000000:2.0:1789050161.644809:0:15405:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baaae53f600 - data ffff8baaa95671b0/ffff8baab4334c00 00000020:01000000:2.0:1789050161.645019:0:15405:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baab4ff9c00 - data ffff8baaa95bb798/ffff8baaae4cc800 00000001:00000004:0.0:1789050161.658114:0:15405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1789050161.708441:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050161.708451:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789050161.708459:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789050161.711881:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789050161.711889:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789050161.711913:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050161.711916:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789050161.712712:0:8622:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789050161.712717:0:8622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789050161.712730:0:8622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789050161.713404:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789050161.713409:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789050161.713430:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050161.713438:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789050161.714000:0:10092:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789050161.714004:0:10092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789050161.714012:0:10092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789050161.732841:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56fe7 00000020:00000080:3.0:1789050161.732856:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baabd16b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789050161.740106:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56ffc 00000020:00000080:3.0:1789050161.740120:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baabd16c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.740251:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789050161.742691:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789050161.742706:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050161.742716:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789050161.742721:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8baa82c10000) has no exports 00000004:01000000:3.0:1789050161.743062:0:15405:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789050161.743073:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57321 00000020:00000080:3.0:1789050161.743083:0:15405:0:(genops.c:885:class_export_put()) final put ffff8ba98274c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.743212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789050161.743276:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789050161.743282:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050161.743290:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789050161.743293:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8baab77f4d40) has no exports 00000020:00000080:3.0:1789050161.743299:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57313 00000020:00000080:3.0:1789050161.743303:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab77fa000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789050161.743322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98274c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789050161.746533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab77fa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789050161.747271:0:15405:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789050161.747277:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789050161.747281:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789050161.747289:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789050161.747305:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050161.747460:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050161.747474:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789050161.747483:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df571c3 00000020:00000080:3.0:1789050161.747492:0:15405:0:(genops.c:885:class_export_put()) final put ffff8ba981a0f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.747524:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab77fc000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789050161.747532:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba983170000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.747541:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba983170000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789050161.747547:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789050161.747705:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789050161.747710:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050161.747716:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789050161.747720:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8baaae6e0000) has no exports 00000020:00000080:3.0:1789050161.747727:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df571bc 00000020:00000080:3.0:1789050161.747733:0:15405:0:(genops.c:885:class_export_put()) final put ffff8ba981a0e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789050161.748029:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba981a0f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1789050161.748602:0:15405:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789050161.748606:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789050161.748609:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789050161.748614:0:15405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789050161.748615:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050161.748652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba981a0e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789050161.748737:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050161.748745:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789050161.748919:0:15405:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789050161.748927:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5701f 00000020:00000080:3.0:1789050161.748933:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab4e22000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.749072:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba981a08800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789050161.749080:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba982283000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.749083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982283000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789050161.749088:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789050161.749214:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789050161.749219:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050161.749224:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789050161.749228:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8baa857a8000) has no exports 00000020:00000080:3.0:1789050161.749233:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57018 00000020:00000080:3.0:1789050161.749237:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baaac622000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789050161.749253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4e22000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789050161.750609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac622000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789050161.750999:0:15405:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789050161.751005:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050161.751009:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789050161.751016:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789050161.751065:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050161.751074:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789050161.751144:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baa90bd1800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789050161.751158:0:37:0:(genops.c:885:class_export_put()) final put ffff8baaac626800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050161.751161:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac626800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789050161.751165:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789050161.751513:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050161.751519:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789050161.751523:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab42bf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789050161.751525:0:15405:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab42bf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789050161.751535:0:15405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789050161.754527:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57003 00000020:00000080:2.0:1789050161.754542:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baabd16a000/lustre-MDD0001_UUID 00000020:01000000:2.0:1789050161.754593:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789050161.754600:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050161.754608:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789050161.754613:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8baabd17cd40) has no exports 00000020:00000080:2.0:1789050161.754646:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050161.754652:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789050161.754656:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5700a 00000020:00000080:2.0:1789050161.754660:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baabd16f800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789050161.754692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789050161.754698:0:37:0:(genops.c:885:class_export_put()) final put ffff8baabd169800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789050161.754700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd169800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789050161.754710:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:2.0:1789050161.758341:0:15405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baab0ea0000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789050161.758352:0:15405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab0ea0000 2 00000020:01000004:2.0:1789050161.758357:0:15405:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8baab0ea0000 from lustre-MDT0001 00000020:00000080:1.0:1789050161.758614:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789050161.758860:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050161.758872:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789050161.758877:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baabd16c800/lustre-MDT0001_UUID 00000020:00000080:2.0:1789050161.758881:0:15405:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789050161.758896:0:15405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789050161.758988:0:15405:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789050161.758994:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789050161.759010:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050161.759015:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789050161.759023:0:15405:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8baab4e20800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050161.759030:0:15405:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8baab4e38000) has exports, disconnecting them 00000020:00080000:2.0:1789050161.759035:0:15405:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8baab4e20800), last request at 1789049928 00000020:00000080:2.0:1789050161.759040:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5705e 00000020:00080000:2.0:1789050161.759054:0:15405:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8baab4e20800): rc 0 00000020:00000080:2.0:1789050161.759058:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab4e20800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789050161.759861:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4e20800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789050161.759984:0:15405:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789050161.759989:0:15405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050161.759994:0:15405:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789050161.760001:0:15405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050161.760023:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab4e26800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789050161.760182:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050161.760189:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789050161.760202:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab4e24000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789050161.760205:0:15405:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4e24000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789050161.760211:0:15405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789050161.760269:0:15405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab0ea0000 1 00000020:00000080:1.0:1789050161.760282:0:15405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56f9a 00000020:00000080:1.0:1789050161.760287:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baab42e4800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789050161.760295:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789050161.760303:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab42e4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789050161.760318:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050161.760323:0:15405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789050161.760326:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8baabd030000) has no exports 00000100:00080000:1.0:1789050161.774905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789050161.774915:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789050161.774919:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050161.774927:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 378 00000100:00080000:1.0:1789050161.774934:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789050161.774967:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ba981a0c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050161.775009:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983d9a300 x1875954714700544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050161.775057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789050161.775061:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789050161.775063:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050161.775068:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 378 00000100:00080000:1.0:1789050161.775071:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789050161.775075:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ba983176800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050161.775088:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a0380 x1875954714700800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050161.775315:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714700672:0@lo:400:kworker.0 00000100:00100000:2.0:1789050161.775377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714700544:0@lo:38:kworker.0 00000100:00100000:1.0:1789050161.775380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050161.775406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050161.775442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714700800:0@lo:38:kworker.0 00000100:00100000:2.0:1789050161.775463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050161.775466:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714700928:0@lo:400:kworker.0 00000100:00100000:1.0:1789050161.781960:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714700672 00000100:00100000:1.0:1789050161.781976:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714700672 00000100:00100000:1.0:1789050161.782020:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714700544 00000100:00100000:1.0:1789050161.782024:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714700544 00000100:00100000:1.0:1789050161.782037:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714700800 00000100:00100000:1.0:1789050161.782039:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714700800 00000100:00100000:1.0:1789050161.782058:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789050161.782065:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875954714700672:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789050161.782074:0:6519:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789050161.782153:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875954714700672:12345-0@lo:400:kworker.0 Request processed in 87us (6772us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789050161.782161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789050161.782176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789050161.782180:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714700544:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789050161.782203:0:6519:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789050161.783090:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714700544:12345-0@lo:38:kworker.0 Request processed in 905us (7679us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050161.783099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789050161.783116:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789050161.783119:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714700800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789050161.783735:0:6519:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789050161.783789:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714700800:12345-0@lo:38:kworker.0 Request processed in 667us (8324us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050161.783798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1789050161.783887:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050161.783891:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ba982284000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789050161.783895:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789050161.785331:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050161.785341:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789050161.785346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714700544:0@lo:38:kworker.0 00000100:00080000:2.0:1789050161.785360:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050161.785489:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789050161.785493:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714700800:0@lo:38:kworker.0 00000100:00100000:3.0:1789050161.786596:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050161.786686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714700928 00000100:00100000:3.0:1789050161.786694:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714700928 00000100:00100000:3.0:1789050161.786731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789050161.786751:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875954714700928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789050161.786759:0:6520:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789050161.786822:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875954714700928:12345-0@lo:400:kworker.0 Request processed in 71us (228us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050161.786828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1789050161.786874:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789050161.786879:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789050161.786882:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789050161.786888:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050161.786891:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:3.0:1789050161.786900:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ba98276b800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050161.786929:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae794e00 x1875954714701056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050161.786965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714700928:0@lo:400:kworker.0 00000100:00100000:3.0:1789050161.786994:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714701056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789050161.787028:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050161.787053:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714701056 00000100:00100000:3.0:1789050161.787057:0:10357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714701056 00000100:00100000:3.0:1789050161.787073:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789050161.787078:0:10357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875954714701056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1789050161.787093:0:10357:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789050161.787124:0:10357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875954714701056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (95us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789050161.787130:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1789050161.790186:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050161.790198:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789050161.790203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714701056:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789050161.807317:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ba982284000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050161.807331:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:1.0:1789050161.807346:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ba982284000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050161.809456:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a2a00 x1875954714701184/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050161.809485:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714700672:0@lo:400:kworker.0 00000100:00100000:3.0:1789050161.817012:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714701184:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789050161.819093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050161.819163:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714701184 00000100:00100000:1.0:1789050161.819172:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714701184 00000100:00100000:1.0:1789050161.819215:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789050161.819222:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714701184:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789050161.819249:0:6520:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789050161.819299:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714701184:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 76us (211us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789050161.819863:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba982284000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050161.819871:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789050161.819876:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714701184:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789050161.819928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000020:00000080:1.0:1789050161.919904:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050161.919919:0:15405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789050161.919926:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baaac606000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789050161.919930:0:15405:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac606000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789050161.921354:0:15405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789050161.925784:0:15405:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8baaac607800 00000020:01000000:0.0:1789050161.925813:0:15405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789050161.925818:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050161.925823:0:15405:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789050161.925827:0:15405:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8baa82c13380) has no exports 00000100:00100000:1.0:1789050161.926025:0:6520:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8baa98582000:6520] 2 exiting: rc = 0 00000100:00100000:3.0:1789050161.926029:0:13807:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8ba983687800:13807] 4 exiting: rc = 0 00000100:00100000:2.0:1789050161.926189:0:10357:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8ba983534c00:10357] 3 exiting: rc = 0 00000100:00100000:3.0:1789050161.926523:0:14070:0:(service.c:3188:ptlrpc_main()) mdt00_005: service thread [ffff8ba9825cac00:14070] 5 exiting: rc = 0 00000100:00100000:3.0:1789050161.926700:0:6519:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8baa98583200:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1789050161.926911:0:6518:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8baa839d1c00:6518] 0 exiting: rc = 1 00000100:00100000:0.0:1789050161.927615:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927634:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927734:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927810:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927821:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927827:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.927832:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.929921:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.929931:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.929951:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.929958:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.929965:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930281:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930289:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930295:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930300:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930429:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930434:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930440:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930444:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930449:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930453:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930457:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930463:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930468:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930473:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930478:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930483:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930489:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930496:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930502:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930508:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930515:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930520:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930525:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930532:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930537:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930542:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930547:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930553:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930558:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930564:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930569:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930575:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930580:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930586:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930593:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930598:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930603:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930608:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930613:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930645:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930651:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930657:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930663:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930668:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930675:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930680:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930686:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930691:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930697:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930703:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930709:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.930717:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.936106:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8baa98582a00:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1789050161.936393:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8baa98583400:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1789050161.937227:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937235:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937241:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937389:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937396:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937401:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937407:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937412:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937419:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937424:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937430:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937436:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937442:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937447:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937452:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937457:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937462:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937467:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937472:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937477:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.937482:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938000:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938010:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938015:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938021:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938026:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938032:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938037:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938042:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938047:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938052:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938057:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938062:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938067:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938073:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938078:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938084:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938090:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938106:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938110:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938116:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938120:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938125:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938130:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938135:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938140:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938145:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938149:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938154:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938158:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938163:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938168:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938173:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938178:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938183:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938188:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938193:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938864:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938874:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938879:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938885:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938890:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938895:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.938901:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.939863:0:13086:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8ba98379f600:13086] 2 exiting: rc = 0 00000100:00100000:2.0:1789050161.940172:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8baab90d7a00:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1789050161.940235:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8baa8515f600:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1789050161.942129:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942140:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942148:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942155:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942162:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942168:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942173:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942179:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942197:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942205:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942210:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942216:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942222:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942228:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942234:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942240:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942246:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942252:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942258:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942264:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942297:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942304:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942309:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942315:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942321:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942327:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942333:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942339:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942346:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942351:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942357:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942363:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942384:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942391:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942397:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942403:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942409:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942415:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942421:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942427:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942434:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942439:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942446:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942451:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942470:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942477:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942481:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942487:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942493:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942498:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942503:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942509:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942515:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942522:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942699:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942713:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942733:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942740:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942746:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942752:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942758:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942763:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942768:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.942774:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.960310:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8baa8515e400:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789050161.960415:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8baa8515fa00:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1789050161.960819:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960828:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960834:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960839:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960845:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960850:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960856:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960861:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960867:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960890:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960895:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960900:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960906:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960912:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960921:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960927:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960932:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960989:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.960996:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961001:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961007:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961012:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961023:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961028:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961033:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961039:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961044:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961049:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961054:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961060:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961066:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961071:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961076:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961081:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961087:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961091:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961096:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961101:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961106:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961111:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961117:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961123:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961129:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961135:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961148:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961159:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961164:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961170:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961175:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961180:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961186:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961191:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961196:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961200:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961206:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961211:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961215:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961220:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961224:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961229:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961235:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961240:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961245:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.961250:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.962517:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8baa8515f000:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1789050161.962789:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8baa8515e800:6527] 0 exiting: rc = 1 00000100:00100000:3.0:1789050161.962980:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.962987:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.962991:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.962996:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963001:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963006:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963011:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963016:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963021:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963026:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963031:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963036:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963041:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963045:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963265:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963271:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963276:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963281:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963286:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963291:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963296:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963302:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963306:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963311:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963315:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963320:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963324:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963329:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963334:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963339:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963345:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963350:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963355:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963359:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963364:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963369:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963375:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963379:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963385:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963390:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963395:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963402:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963406:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963411:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963416:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963421:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963426:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963432:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963437:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963450:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963455:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963461:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963466:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963471:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963477:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963481:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963594:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963602:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963607:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963612:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963617:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963633:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963688:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.963696:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050161.964425:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8baa8515f200:6529] 0 exiting: rc = 1 00000100:00100000:1.0:1789050161.964735:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8baa877f1e00:6530] 1 exiting: rc = 0 00000100:00100000:3.0:1789050161.964911:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.964918:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.964924:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.964929:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.964934:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965126:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965132:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965137:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965142:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965147:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965152:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965156:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965162:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965166:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965171:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965175:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965180:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965184:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965189:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965193:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965210:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965215:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965220:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965225:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965230:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965235:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965240:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965246:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965251:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965256:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965260:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965265:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965270:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965274:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965279:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965283:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965289:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965294:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965299:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965304:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965309:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965314:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965320:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965325:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965331:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965336:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965341:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965346:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965351:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965356:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965361:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965366:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965371:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965376:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965381:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965393:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965399:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965404:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965409:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965414:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965420:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965424:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965429:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050161.965434:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.966681:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8baab9282c00:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1789050161.967139:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8baab9283e00:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1789050161.967324:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8baab9283c00:6533] 2 exiting: rc = 0 00000100:00100000:1.0:1789050161.967426:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967433:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967455:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967462:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967468:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967475:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967481:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967496:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967503:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967509:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967515:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967521:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967548:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967553:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967559:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967565:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967570:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967575:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967581:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967587:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967592:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967599:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967605:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967610:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967616:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967631:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967801:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967809:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967815:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967821:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967826:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967832:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967837:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967843:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967852:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967857:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967868:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967873:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967878:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967883:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967889:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967894:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967900:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967906:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967911:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967917:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967922:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967967:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967975:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.967980:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968004:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968010:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968015:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968020:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968025:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968030:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968036:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968041:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968046:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968050:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968056:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968061:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968066:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050161.968072:0:15405:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789050161.974711:0:15405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050161.974725:0:15405:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789050161.974731:0:15405:0:(genops.c:885:class_export_put()) final put ffff8baa85706000/MDS_uuid 00000020:00000080:1.0:1789050161.974735:0:15405:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85706000/MDS_uuid for MDS 00000020:01000000:1.0:1789050161.974741:0:15405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789050161.975134:0:15405:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789050162.347492:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050163.370653:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050164.394119:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050165.426875:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789050165.697448:0:15606:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789050165.720454:0:15606:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789050165.720536:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.720555:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.720564:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.720573:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.720670:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789050165.720679:0:15606:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789050165.720713:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050165.720718:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789050165.720740:0:15606:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789050165.720748:0:15606:0:(import.c:65:import_set_state_nolock()) ffff8ba981a0c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789050165.720754:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050165.720756:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789050165.720760:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789050165.721686:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789050165.721691:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789050165.721697:0:15606:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789050165.721701:0:15606:0:(import.c:65:import_set_state_nolock()) ffff8ba982284000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789050165.721706:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789050165.721708:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789050165.721711:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789050165.722682:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.722702:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.722710:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.722718:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050165.723466:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050165.723528:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050165.723541:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.723550:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.723573:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.723580:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050165.726955:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789050165.726974:0:15606:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789050165.727028:0:15606:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789050165.727034:0:15606:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789050165.727046:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050165.727054:0:15606:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789050165.727064:0:15606:0:(genops.c:1818:print_export_data()) lustre-OST0000: UNLINKED ffff8baa85747000 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:0.0:1789050165.727074:0:15606:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8baabd0319c0) has no exports 00000020:00080000:0.0:1789050165.727106:0:15606:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8baabd0319c0) has no exports 00010000:00010000:1.0:1789050165.729089:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050165.729107:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729122:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a5800 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050165.729126:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729138:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050165.729171:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050165.729176:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789050165.729179:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789050165.729183:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789050165.729205:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:1.0:1789050165.729209:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729216:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a5800/0x3b8ec5973df573e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729234:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050165.729239:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729245:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043c00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050165.729248:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729254:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050165.729260:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050165.729266:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789050165.729268:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789050165.729276:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789050165.729283:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:1.0:1789050165.729286:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729292:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baac2043c00/0x3b8ec5973df57669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df57670 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050165.729301:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050165.729303:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050165.729305:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050165.729462:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050165.729478:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050165.729482:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050165.729489:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050165.729495:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050165.729501:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050165.729503:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789050165.729505:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789050165.729513:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:2.0:1789050165.729516:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050165.729523:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df573d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050165.729636:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050165.729639:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050165.729641:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050165.729646:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050166.441251:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789050166.889171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b8839590-fd25-4606-bad2-917c49937107->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789050166.889182:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b8839590-fd25-4606-bad2-917c49937107->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050166.889185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789050166.889190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789050166.889194:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050166.889205:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 383 00000100:00080000:1.0:1789050166.889213:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789050166.889229:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ba983176800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050166.889278:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a1500 x1875954714701312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050166.889327:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789050166.889331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789050166.889333:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050166.889337:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 383 00000100:00080000:1.0:1789050166.889340:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789050166.889429:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ba98276b800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050166.889445:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a1880 x1875954714701440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050166.889793:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714701312:0@lo:38:kworker.0 00000400:00000100:0.0:1789050166.889924:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875954714701312 offset 0 length 520: 4 00000100:00100000:0.0:1789050166.890138:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714701440:0@lo:38:kworker.0 00000400:00000100:0.0:1789050166.890162:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875954714701440 offset 0 length 520: 4 00010000:00010000:3.0:1789050167.466070:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789050167.914614:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789050167.914624:0:8427:0:(genops.c:885:class_export_put()) final put ffff8baa85747000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789050167.915222:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85747000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789050167.915269:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baa85740800 for lustre-OST0000 00000001:00100000:1.0:1789050167.915998:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789050167.916009:0:9512:0:(genops.c:885:class_export_put()) final put ffff8baab77f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789050167.921895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab77f8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789050167.922008:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab77f9000 for lustre-OST0001 00010000:00010000:3.0:1789050168.491123:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050169.513149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050170.538704:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050171.561739:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789050171.817109:0:15606:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ba981bb32a0 - data ffff8baaa974e6c0/ffff8ba98344e400 00000020:01000000:0.0:1789050171.817483:0:15606:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baab41ef3c0 - data ffff8baaa96e3288/ffff8baab5bb7800 00100000:10000000:0.0:1789050171.835093:0:15606:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789050171.852831:0:15606:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57137 00000020:00000080:2.0:1789050171.852871:0:15606:0:(genops.c:885:class_export_put()) final put ffff8baabd16e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789050171.852891:0:15606:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baaac621000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789050171.852895:0:15606:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac621000 2 00000020:01000004:2.0:1789050171.852898:0:15606:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8baaac621000 from lustre-OST0000 00000020:00000080:2.0:1789050171.852927:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050171.852961:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789050171.852973:0:15606:0:(genops.c:885:class_export_put()) final put ffff8baa90bd2800/lustre-OST0000_UUID 00000020:00000080:2.0:1789050171.852976:0:15606:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa90bd2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789050171.852992:0:15606:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789050171.853043:0:15606:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789050171.853048:0:15606:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789050171.853052:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050171.853058:0:15606:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789050171.853064:0:15606:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ba982285000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050171.853070:0:15606:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8baab4e3b380) has exports, disconnecting them 00000020:00080000:2.0:1789050171.853074:0:15606:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ba982285000), last request at 1789049948 00000020:00000080:2.0:1789050171.853078:0:15606:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57161 00000020:00080000:2.0:1789050171.853087:0:15606:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba982285000): rc 0 00000020:00000080:2.0:1789050171.853092:0:15606:0:(genops.c:885:class_export_put()) final put ffff8ba982285000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789050171.853659:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8baabd16e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789050171.853673:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982285000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789050171.856114:0:15606:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789050171.856121:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789050171.856126:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789050171.856132:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050171.856308:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050171.856317:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789050171.856322:0:15606:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789050171.856353:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050171.856370:0:15606:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789050171.856377:0:15606:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ba982287000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789050171.856384:0:15606:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8baab4e3cd40) has exports, disconnecting them 00000020:00080000:3.0:1789050171.856388:0:15606:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ba982287000), last request at 1789049948 00000020:00000080:3.0:1789050171.856392:0:15606:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57176 00000020:00080000:3.0:1789050171.856407:0:15606:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba982287000): rc 0 00000020:00000080:3.0:1789050171.856413:0:15606:0:(genops.c:885:class_export_put()) final put ffff8ba982287000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789050171.856425:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba981a0c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789050171.856435:0:38:0:(genops.c:885:class_export_put()) final put ffff8ba981a09800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789050171.856438:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba981a09800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789050171.856448:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789050171.856560:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982287000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789050171.863634:0:15606:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789050171.863643:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789050171.863647:0:15606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789050171.863655:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050171.863919:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050171.863930:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789050171.863955:0:15606:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baaac621000 1 00000020:00000080:3.0:1789050171.863963:0:15606:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df570ff 00000020:00000080:3.0:1789050171.863972:0:15606:0:(genops.c:885:class_export_put()) final put ffff8baa85743000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789050171.865740:0:15606:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789050171.865746:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba982284000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789050171.865753:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050171.865760:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba982281800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789050171.865761:0:15606:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1789050171.865763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982281800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:00080000:3.0:1789050171.865765:0:15606:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8baab4e399c0) has no exports 00000020:01000000:0.0:1789050171.865771:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789050171.867343:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85743000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789050171.905503:0:15606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050171.905518:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789050171.905524:0:15606:0:(genops.c:885:class_export_put()) final put ffff8baaac624800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789050171.905529:0:15606:0:(genops.c:844:class_export_destroy()) destroying export ffff8baaac624800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789050171.905542:0:15606:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789050171.905675:0:15606:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8baaac623000 00000020:02000400:2.0:1789050171.905788:0:15606:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1789050172.011048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b8839590-fd25-4606-bad2-917c49937107->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789050172.011058:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b8839590-fd25-4606-bad2-917c49937107->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050172.011061:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789050172.011065:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050172.011067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789050172.011070:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050172.012304:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050161/real 1789050161] req@ffff8ba983d9a680 x1875954714700416/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789050171 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050172.012532:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba983d9a680 x1875954714700416/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789050171 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050172.012567:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab0e92000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050172.012581:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789050172.012585:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714700416:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1789050172.012668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b8839590-fd25-4606-bad2-917c49937107->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789050172.012674:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789050172.012677:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baab0e92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050172.012681:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1789050172.012686:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789050172.012698:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import ffff8baab0e92000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050172.012733:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2ea00 x1875954714701568/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050172.012758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789050172.012777:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050172.012780:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789050172.012783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050172.012833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714701568:0@lo:250:kworker.0 00000400:00000100:0.0:1789050172.012878:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875954714701568 offset 0 length 520: 4 00010000:00010000:1.0:1789050172.585243:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050173.616470:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050174.635081:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789050175.362644:0:15807:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789050175.376629:0:15807:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789050175.376792:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050175.376808:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050175.376817:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050175.376824:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050175.376883:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050175.376889:0:15807:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789050175.376911:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050175.376921:0:15807:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baab78a1500 x1875954714701312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050175.376970:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789050175.376977:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789050175.376983:0:15807:0:(import.c:65:import_set_state_nolock()) ffff8ba983176800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789050175.376988:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050175.376991:0:15807:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baab78a1500 x1875954714701312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050186 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050175.377018:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050175.377022:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1789050175.377791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714701312:0@lo:38:kworker.0 00000100:00080000:2.0:1789050175.380170:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789050175.380187:0:15807:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baab78a1880 x1875954714701440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050175.380204:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789050175.380210:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789050175.380216:0:15807:0:(import.c:65:import_set_state_nolock()) ffff8ba98276b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789050175.380222:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789050175.380226:0:15807:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8baab78a1880 x1875954714701440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050181 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050175.380232:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050175.380235:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1789050175.380363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714701440:0@lo:38:kworker.0 00010000:00010000:3.0:1789050175.381369:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381383:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381390:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381398:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381571:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050175.381580:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381588:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381594:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381600:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381618:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789050175.381623:0:15807:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1789050175.381637:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789050175.381645:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789050175.381650:0:15807:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1789050175.381652:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7a00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050175.381655:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381665:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050175.381672:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050175.381679:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789050175.381681:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789050175.381684:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789050175.381697:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:1.0:1789050175.381701:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1789050175.381703:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1789050175.381708:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d7a00/0x3b8ec5973df573bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381715:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050175.381720:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381725:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae5a4200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789050175.381728:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381732:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050175.381735:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381735:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381741:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:3.0:1789050175.381743:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050175.381744:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381750:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050175.381753:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050175.381756:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:00010000:1.0:1789050175.381757:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050175.381758:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789050175.381762:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789050175.381763:0:8449:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 10000000:01000000:1.0:1789050175.381764:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789050175.381765:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789050175.381766:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381770:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:3.0:1789050175.381772:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae5a4200/0x3b8ec5973df573c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df573d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381773:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050175.381779:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa80031600/0x3b8ec5973df5765b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df57662 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.381782:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050175.381784:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050175.381785:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050175.381791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789050175.381793:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1789050175.381793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050175.381794:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789050175.381800:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789050175.381804:0:15807:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8baaae6e19c0) has no exports 00000020:00080000:3.0:1789050175.381828:0:15807:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8baaae6e19c0) has no exports 00010000:00010000:0.0:1789050175.382503:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789050175.384185:0:15807:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ba981bb3c00 - data ffff8baaa9642438/ffff8baaae5bc400 00000020:01000000:3.0:1789050175.384371:0:15807:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baa864fbea0 - data ffff8baaa9696438/ffff8baaae70fc00 00100000:10000000:2.0:1789050175.403568:0:15807:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789050175.420063:0:15807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5725d 00000020:00000080:3.0:1789050175.420074:0:15807:0:(genops.c:885:class_export_put()) final put ffff8ba982769800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789050175.420085:0:15807:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baab4394800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789050175.420089:0:15807:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab4394800 2 00000020:01000004:3.0:1789050175.420092:0:15807:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8baab4394800 from lustre-OST0001 00000020:00000080:3.0:1789050175.420115:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050175.420125:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789050175.420128:0:15807:0:(genops.c:885:class_export_put()) final put ffff8ba982768800/lustre-OST0001_UUID 00000020:00000080:3.0:1789050175.420131:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982768800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789050175.420138:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789050175.420261:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b8839590-fd25-4606-bad2-917c49937107->MGS 00000020:00000080:1.0:1789050175.420372:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba982769800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1789050175.421395:0:15807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa829d7000/0x3b8ec5973df56fb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050175.421411:0:15807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa829d7000/0x3b8ec5973df56fb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050175.421417:0:15807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789050175.421420:0:15807:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789050175.421424:0:15807:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789050175.421442:0:15807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:3.0:1789050175.421446:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa829d7000/0x3b8ec5973df56fb6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df56fbd expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050175.421468:0:15807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050175.421475:0:15807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050175.421479:0:15807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050175.421482:0:15807:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789050175.421483:0:15807:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789050175.421493:0:15807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8baab0e92000 00010000:00010000:3.0:1789050175.421496:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae779e00/0x3b8ec5973df5742b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3b8ec5973df57432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789050175.421513:0:15807:0:(import.c:65:import_set_state_nolock()) ffff8baab0e92000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789050175.421517:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789050175.421519:0:15807:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789050175.421520:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789050175.421716:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789050175.421740:0:15807:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba983f2ea00 x1875954714701568/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789050187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789050175.421756:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789050175.421759:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1789050175.421843:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8839590-fd25-4606-bad2-917c49937107:3643:1875954714701568:0@lo:250:kworker.0 10000000:01000000:3.0:1789050175.421906:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789050175.421914:0:15807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df56eb3 00000020:00000080:3.0:1789050175.421921:0:15807:0:(genops.c:885:class_export_put()) final put ffff8baa85702800/b8839590-fd25-4606-bad2-917c49937107 00000020:01000000:3.0:1789050175.421996:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.142@tcp (flags='') 00000020:00000080:3.0:1789050175.422003:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050175.422009:0:15807:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789050175.422013:0:15807:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8baa857ab380) has no exports 10000000:01000000:0.0:1789050175.422182:0:6515:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789050175.422383:0:15807:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.203.142@tcp: client import never connected 00000100:00080000:3.0:1789050175.422386:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789050175.422388:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789050175.422390:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789050175.422392:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789050175.424064:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85702800/b8839590-fd25-4606-bad2-917c49937107 for MGC192.168.203.142@tcp 00000020:00000080:3.0:1789050175.425488:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050175.425501:0:15807:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.142@tcp (uuid b8839590-fd25-4606-bad2-917c49937107) 00000020:01000000:3.0:1789050175.425511:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789050175.425518:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050175.425523:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789050175.425550:0:15807:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ba983170800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789050175.425557:0:15807:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8baabd17b380) has exports, disconnecting them 00000020:00080000:3.0:1789050175.425562:0:15807:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ba983170800), last request at 1789049968 00000020:00000080:3.0:1789050175.425567:0:15807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df57287 00000020:00080000:3.0:1789050175.425585:0:15807:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba983170800): rc 0 00000020:00000080:3.0:1789050175.425589:0:15807:0:(genops.c:885:class_export_put()) final put ffff8ba983170800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789050175.430784:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8baab0e92000 for MGC192.168.203.142@tcp 00000020:00000080:1.0:1789050175.430805:0:38:0:(genops.c:885:class_export_put()) final put ffff8baab0e96000/b8839590-fd25-4606-bad2-917c49937107 00000020:00000080:1.0:1789050175.430809:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab0e96000/b8839590-fd25-4606-bad2-917c49937107 for MGC192.168.203.142@tcp 00000020:01000000:1.0:1789050175.430818:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.142@tcp (b8839590-fd25-4606-bad2-917c49937107) 00000020:00000080:1.0:1789050175.432364:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba983170800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789050175.433732:0:15807:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789050175.433737:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050175.433742:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789050175.433749:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050175.433926:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050175.433934:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789050175.433957:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789050175.433961:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050175.433966:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789050175.433973:0:15807:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ba98276d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050175.433979:0:15807:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8baaae6e3380) has exports, disconnecting them 00000020:00080000:1.0:1789050175.433984:0:15807:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ba98276d800), last request at 1789049968 00000020:00000080:1.0:1789050175.433988:0:15807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5729c 00000020:00080000:1.0:1789050175.434002:0:15807:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba98276d800): rc 0 00000020:00000080:1.0:1789050175.434007:0:15807:0:(genops.c:885:class_export_put()) final put ffff8ba98276d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789050175.434766:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba983176800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789050175.434776:0:38:0:(genops.c:885:class_export_put()) final put ffff8ba983174000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789050175.434779:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba983174000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789050175.434785:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789050175.434860:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98276d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789050175.459005:0:15807:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789050175.459013:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789050175.459019:0:15807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789050175.459027:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050175.459056:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8ba98276b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789050175.459108:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789050175.466859:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789050175.471032:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789050175.481843:0:9521:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8ba982751c00:9521] 2 exiting: rc = 0 00000100:00100000:3.0:1789050175.482003:0:6502:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8baab936d000:6502] 1 exiting: rc = 0 00000100:00100000:3.0:1789050175.482061:0:6501:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8baab936c200:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1789050175.482123:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.482398:0:7461:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8baab42f1800:7461] 4 exiting: rc = 0 00000100:00100000:3.0:1789050175.482467:0:6503:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8baa85f96c00:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1789050175.482883:0:7460:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8baaac4f5c00:7460] 3 exiting: rc = 0 00000100:00100000:1.0:1789050175.483022:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8baa85f97e00:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1789050175.483072:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8baa85f97800:6505] 2 exiting: rc = 0 00000100:00100000:3.0:1789050175.483180:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483187:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483194:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483201:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483207:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483214:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483219:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483225:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483231:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483237:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483243:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483249:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483255:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483261:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483268:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483274:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483279:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483285:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483305:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483312:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483319:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483324:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483329:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483334:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483339:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483345:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483350:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483355:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483361:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483366:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483371:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483376:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483381:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483387:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483392:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483397:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483402:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483407:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483412:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483418:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483423:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483428:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483434:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483439:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483444:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483448:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483454:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483458:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483463:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483469:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483475:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483480:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483485:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483498:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483503:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483508:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483513:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483519:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483859:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483869:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483875:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483880:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483884:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.483899:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789050175.487037:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050175.487049:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789050175.487055:0:15807:0:(genops.c:885:class_export_put()) final put ffff8ba98276b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789050175.487060:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba98276b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789050175.487067:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789050175.487120:0:15807:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baab4394800 1 00000020:00000080:3.0:1789050175.487126:0:15807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3b8ec5973df5722c 00000020:00000080:3.0:1789050175.487132:0:15807:0:(genops.c:885:class_export_put()) final put ffff8baab7755000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789050175.487143:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789050175.487154:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab7755000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789050175.487165:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050175.487170:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789050175.487174:0:15807:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8baabd034d40) has no exports 00000020:00000080:0.0:1789050175.538496:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050175.538510:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789050175.538516:0:15807:0:(genops.c:885:class_export_put()) final put ffff8baab4392800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789050175.538521:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff8baab4392800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789050175.542629:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789050175.543143:0:15807:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8baab4397000 00000020:01000000:3.0:1789050175.543213:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789050175.543220:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050175.543226:0:15807:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789050175.543231:0:15807:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8baabd1799c0) has no exports 00000020:00000080:3.0:1789050175.543264:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050175.543273:0:15807:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789050175.543278:0:15807:0:(genops.c:885:class_export_put()) final put ffff8baa85746800/OSS_uuid 00000020:00000080:3.0:1789050175.543282:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff8baa85746800/OSS_uuid for OSS 00000020:01000000:3.0:1789050175.543286:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789050175.543491:0:6514:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789050175.543645:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8baab4264600:8432] 0 exiting: rc = 1 00000100:00100000:1.0:1789050175.543724:0:8629:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8baaae6b0c00:8629] 3 exiting: rc = 0 00000100:00100000:2.0:1789050175.544469:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8baaae538000:8434] 2 exiting: rc = 0 00000100:00100000:2.0:1789050175.545415:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8baabd0d8600:8433] 1 exiting: rc = 0 00000100:00100000:1.0:1789050175.545517:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545552:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545559:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545565:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545571:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545576:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545581:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545587:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545592:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545598:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545605:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545609:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545615:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545619:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545625:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545630:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545634:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545639:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545644:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545659:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545666:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545671:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545676:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545681:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545686:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545691:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545696:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545701:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545717:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545724:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545730:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545735:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545740:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545746:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545752:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545757:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545770:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545776:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545782:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545787:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545793:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545798:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545804:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545809:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545813:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545818:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545824:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545829:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545834:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545839:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545845:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545851:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545858:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545862:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545867:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545871:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545875:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545880:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545885:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545890:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545895:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545899:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545904:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.545916:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050175.547969:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8baab138b800:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1789050175.548094:0:10154:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8baaae6cd200:10154] 2 exiting: rc = 0 00000100:00100000:2.0:1789050175.548661:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8baaae514000:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1789050175.548773:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548782:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548789:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548794:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548799:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548804:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548823:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548828:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548833:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548839:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548844:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.548849:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549075:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549086:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549095:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549104:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549111:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549117:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549124:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549133:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549141:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549150:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549157:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549166:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549174:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549510:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549519:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549532:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549537:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549541:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549546:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549552:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549558:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549562:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549568:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549573:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549578:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549583:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549588:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549593:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549599:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549614:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549618:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549623:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549628:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549633:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549639:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549644:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549650:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549901:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549907:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549912:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549917:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549923:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549928:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.549932:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550133:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550140:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550145:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550151:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550156:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550162:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550168:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.550174:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.553018:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8baab4ea1800:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1789050175.553284:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8baab4ea1400:8440] 2 exiting: rc = 0 00000100:00100000:0.0:1789050175.556274:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8baaae52bc00:8438] 0 exiting: rc = 1 00000100:00100000:2.0:1789050175.557818:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557828:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557833:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557839:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557846:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557852:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557858:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557863:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557869:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557874:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557880:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557900:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557905:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557910:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557917:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557922:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557928:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.557933:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558013:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558031:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558038:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558044:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558050:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558055:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558060:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558066:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558071:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558077:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558083:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558089:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558094:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558100:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558105:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558110:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558115:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558122:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558127:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558133:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558139:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558144:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558150:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558155:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558161:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558182:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558189:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558194:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558206:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558211:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558216:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558534:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558542:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558548:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558554:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558560:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558566:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558572:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558579:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558585:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558590:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558596:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558602:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558608:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558614:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.558619:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050175.563102:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8baaae469200:8441] 0 exiting: rc = 1 00000100:00100000:3.0:1789050175.563779:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8baaae9ff000:8442] 1 exiting: rc = 0 00000100:00100000:2.0:1789050175.563914:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.563922:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.563928:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.563934:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564141:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564146:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564152:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564159:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564164:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564170:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564175:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564181:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564187:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564193:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564198:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564203:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564208:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564402:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564411:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564417:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564422:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564427:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564432:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564438:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564442:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564447:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564452:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564457:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564462:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564466:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564471:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564476:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564480:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564485:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564489:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564494:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564498:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564502:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564507:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564512:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564516:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564521:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564538:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564544:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564549:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564554:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564559:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564564:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564568:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564573:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564578:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564583:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564595:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564600:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564605:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564610:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564615:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564620:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564625:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564630:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564635:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564640:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564645:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.564721:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050175.566002:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8baaae9ff200:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1789050175.566192:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8baaae9ffc00:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1789050175.566284:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566356:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566362:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566368:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566374:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566379:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566385:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566390:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566406:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566412:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566418:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566424:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566441:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566447:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566453:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566459:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566465:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566470:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566476:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566482:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566499:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566505:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566510:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566516:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566522:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566540:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566547:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566552:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566558:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566563:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566568:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566574:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566592:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566598:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566604:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566610:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566616:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566622:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566628:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566634:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566640:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566645:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566709:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566718:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566737:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566743:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566749:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566760:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566768:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566774:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566780:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566785:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566791:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566797:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566803:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566808:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566824:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566830:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566835:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566841:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566847:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566853:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566859:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050175.566865:0:15807:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789050175.591065:0:15807:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789050197.505189:0:16571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789050208.011596:0:17171:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789050208.011601:0:17171:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789050208.011603:0:17171:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789050208.011708:0:17171:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba983e8d000 00000020:01000004:3.0:1789050208.011724:0:17171:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789050208.011732:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789050208.011748:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8baaae6e3380) 00000020:00000080:3.0:1789050208.011762:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789050208.067464:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789050208.067782:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789050208.071022:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789050208.071385:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.072878:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.073168:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.074203:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.074487:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.074956:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.075208:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.075553:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.075800:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.076030:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.076275:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.076593:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.076786:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.077082:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.077616:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.078795:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.079137:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.079454:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.079769:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.080010:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.080238:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.080544:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.080826:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.081069:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.081578:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.081968:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.082245:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.082771:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.083008:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.087497:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789050208.092384:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789050208.097357:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789050208.098709:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789050208.099419:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.103765:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789050208.104262:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.104595:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.104791:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.104996:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789050208.105684:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789050208.105906:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789050208.106622:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.106872:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789050208.108122:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.110606:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.111265:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.111887:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.112618:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.112801:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789050208.113063:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1789050208.117032:0:17171:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789050208.117322:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789050208.117331:0:17171:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789050208.117343:0:17171:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df58462 00000020:01000004:1.0:1789050208.117352:0:17171:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789050208.117357:0:17171:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789050208.117362:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba983e8d000 from MGS 00000020:01000004:1.0:1789050208.117366:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789050208.117393:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8baab77f4d40) 00000020:00000080:1.0:1789050208.117406:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789050208.117633:0:17171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba983e8d000 from MGS, refs=2 00080000:01000000:1.0:1789050208.117638:0:17171:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789050208.117643:0:17171:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df58470 00000100:00100000:1.0:1789050208.117734:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789050208.117856:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789050208.117862:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789050208.119358:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789050208.119493:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789050208.120661:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050208.120846:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789050208.120851:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789050208.121690:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789050208.121698:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789050208.122082:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789050208.122088:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789050208.122752:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.122755:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.122757:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.123622:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.123626:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.123627:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050208.124096:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789050208.129693:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789050208.130848:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789050208.131730:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789050208.131837:0:17171:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789050208.131869:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789050208.132507:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789050208.132808:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050208.135201:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789050208.135213:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789050208.147661:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789050208.147673:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789050208.150060:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789050208.150135:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789050208.151168:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789050208.151189:0:17171:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.142@tcp' 00000020:01000004:2.0:1789050208.151191:0:17171:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789050208.151223:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.142@tcp (typ=mgc) 00000020:00000080:2.0:1789050208.151235:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.142@tcp (ffff8baa857acd40) 00000020:00000080:2.0:1789050208.151250:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789050208.151346:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba9844a3800@MGC192.168.203.142@tcp: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050208.151607:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.142@tcp-0 is initialized 00000040:01000000:2.0:1789050208.151614:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789050208.152169:0:17189:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1789050208.152419:0:17188:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789050208.154821:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.142@tcp (uuid e9e852cd-105e-4a2b-8f2f-088fc33df062) 00000020:00000080:1.0:1789050208.154851:0:17171:0:(genops.c:1384:class_connect()) connect: client e9e852cd-105e-4a2b-8f2f-088fc33df062, cookie 0x3b8ec5973df5847e 00000100:00080000:1.0:1789050208.154863:0:17171:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789050208.154875:0:17171:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import ffff8ba9844a3800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050208.154907:0:17171:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a2680 x1875954714701696/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050208.154933:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e9e852cd-105e-4a2b-8f2f-088fc33df062->MGS 00000020:01000004:1.0:1789050208.154969:0:17171:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789050208.155000:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789050208.155013:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8baab77f0000) 00000020:00000080:1.0:1789050208.155027:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789050208.159573:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9e852cd-105e-4a2b-8f2f-088fc33df062:3643:1875954714701696:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789050208.159652:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.166213:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714701696 00000100:00100000:3.0:1789050208.166228:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714701696 00000100:00100000:3.0:1789050208.166278:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050208.166286:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875954714701696:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789050208.166323:0:17185:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e9e852cd-105e-4a2b-8f2f-088fc33df062@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1789050208.166352:0:17185:0:(genops.c:1384:class_connect()) connect: client e9e852cd-105e-4a2b-8f2f-088fc33df062, cookie 0x3b8ec5973df5848c 00000100:00080000:3.0:1789050208.167896:0:17185:0:(import.c:65:import_set_state_nolock()) ffff8ba983e89800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050208.168011:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:3643:x1875954714701696:12345-0@lo:250:mount.lustre.0 Request processed in 1723us (8357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.168022:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050208.168132:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789050208.168141:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1789050208.168149:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789050208.168154:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789050208.168158:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ba9844a3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789050208.168160:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789050208.168177:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789050208.168183:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9e852cd-105e-4a2b-8f2f-088fc33df062:3643:1875954714701696:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789050208.175034:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050208.175337:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789050208.175346:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789050208.180197:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789050208.180211:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789050208.180735:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789050208.180742:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789050208.181814:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789050208.182166:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789050208.182173:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789050208.182742:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789050208.182749:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789050208.234406:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050208.234788:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789050208.234795:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789050208.236152:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789050208.236163:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789050208.237283:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050208.237734:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789050208.237740:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789050208.238732:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789050208.238741:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789050208.240075:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050208.240248:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789050208.240253:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789050208.241115:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789050208.241122:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789050208.244817:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050208.245175:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789050208.245247:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789050208.246065:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789050208.246072:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789050208.289789:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789050208.290113:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789050208.290120:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789050208.291481:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789050208.291492:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789050208.293811:0:17171:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789050208.293827:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789050208.294810:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789050208.294836:0:17171:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789050208.294842:0:17171:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789050208.294974:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789050208.295005:0:17171:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789050208.295009:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789050208.295011:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789050208.295012:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050208.295014:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050208.295015:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050208.295016:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050208.295018:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050208.295019:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789050208.295021:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050208.295022:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050208.295024:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789050208.295026:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050208.295027:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789050208.295029:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050208.295030:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050208.295031:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050208.295032:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050208.295038:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050208.295039:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789050208.295040:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050208.295041:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050208.295066:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789050208.295085:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714701824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050208.295154:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050208.295256:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa207cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.295595:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714701824 00000100:00100000:0.0:1789050208.295603:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714701824 00000100:00100000:0.0:1789050208.295685:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050208.295695:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:17171:x1875954714701824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050208.295736:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789050208.295739:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789050208.295742:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789050208.296060:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789050208.296573:0:17187:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789050208.298006:0:17209:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789050208.298012:0:17209:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789050208.298015:0:17209:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789050208.298018:0:17209:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789050208.298252:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789050208.298607:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789050208.298616:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789050208.300279:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:17171:x1875954714701824:12345-0@lo:253:mount.lustre.0 Request processed in 4579us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.300847:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050208.300998:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714701824:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050208.301013:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789050208.301017:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050208.301018:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050208.301020:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050208.301021:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050208.301022:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050208.301023:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050208.301025:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050208.301026:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050208.301028:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050208.301029:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789050208.301049:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba983e8d000 from lustre-MDT0000 10000000:01000000:1.0:1789050208.301079:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789050208.301082:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789050208.301087:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8baa857acd40 10000000:01000000:1.0:1789050208.301091:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050208.301099:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8baa857acd40 from 1 10000000:01000000:1.0:1789050208.301102:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789050208.301139:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.301150:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.301159:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.301202:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714701952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050208.301242:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.301281:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.301529:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714701952 00000100:00100000:3.0:1789050208.301535:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714701952 00000100:00100000:3.0:1789050208.301580:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050208.301590:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:17171:x1875954714701952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050208.301602:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050208.301615:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602400/0x3b8ec5973df5849a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58493 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.301637:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602400/0x3b8ec5973df5849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58493 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.301647:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602400/0x3b8ec5973df5849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58493 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.301656:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602400, rc 0) 00000100:00100000:3.0:1789050208.301707:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:17171:x1875954714701952:12345-0@lo:101:mount.lustre.0 Request processed in 118us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.301714:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050208.301844:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714701952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050208.301858:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.301867:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.301918:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050208.301976:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.301996:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.302046:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702080 00000100:00100000:0.0:1789050208.302051:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702080 00000100:00100000:0.0:1789050208.302071:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050208.302077:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:17171:x1875954714702080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050208.302150:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:17171:x1875954714702080:12345-0@lo:501:mount.lustre.0 Request processed in 72us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050208.302157:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050208.302278:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702080:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789050208.302317:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789050208.302335:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302343:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050208.302350:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba983e8d000 10000000:01000000:1.0:1789050208.302355:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789050208.302359:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ba983e8d000 10000000:01000000:1.0:1789050208.302361:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789050208.302364:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ba983e8d000 from 1 10000000:01000000:1.0:1789050208.302373:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789050208.302391:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302398:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302406:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.302417:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050208.302560:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.302573:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.302628:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702208 00000100:00100000:0.0:1789050208.302633:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702208 00000100:00100000:0.0:1789050208.302651:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050208.302658:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:17171:x1875954714702208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050208.302666:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050208.302677:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1000/0x3b8ec5973df584a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df584a1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.302691:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1000/0x3b8ec5973df584a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df584a1 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.302700:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1000/0x3b8ec5973df584a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df584a1 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.302708:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1000, rc 0) 00000100:00100000:0.0:1789050208.302741:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+7:17171:x1875954714702208:12345-0@lo:101:mount.lustre.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.302753:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050208.302819:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050208.302830:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584a8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302837:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df584a8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050208.302848:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789050208.302861:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584a8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302867:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571000/0x3b8ec5973df584a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584a8 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050208.302872:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789050208.302875:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050208.302885:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ba983e8d000 10000000:01000000:1.0:1789050208.302887:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789050208.302890:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789050208.302891:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789050208.302905:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302911:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.302917:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.302928:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050208.302970:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.302986:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.303034:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702336 00000100:00100000:0.0:1789050208.303039:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702336 00000100:00100000:0.0:1789050208.303055:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050208.303060:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+7:17171:x1875954714702336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050208.303066:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050208.303073:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0c00/0x3b8ec5973df584b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df584af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.303086:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0c00/0x3b8ec5973df584b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df584af expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.303095:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0c00/0x3b8ec5973df584b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df584af expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.303101:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0c00, rc 0) 00000100:00100000:0.0:1789050208.303134:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+8:17171:x1875954714702336:12345-0@lo:101:mount.lustre.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.303140:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050208.303206:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050208.303216:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584b6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.303225:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df584b6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.303269:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050208.303402:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.303423:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.303534:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702464 00000100:00100000:0.0:1789050208.303538:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702464 00000100:00100000:0.0:1789050208.303555:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050208.303561:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+8:17171:x1875954714702464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050208.303680:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17171:x1875954714702464:12345-0@lo:501:mount.lustre.0 Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.303686:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050208.303802:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050208.303829:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050208.303873:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.303894:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.303958:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702592 00000100:00100000:0.0:1789050208.303968:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702592 00000100:00100000:0.0:1789050208.303995:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789050208.304001:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17171:x1875954714702592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050208.304764:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17171:x1875954714702592:12345-0@lo:503:mount.lustre.0 Request processed in 761us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.304771:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050208.304854:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714702592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050208.305415:0:17210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17210:1875954714702720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050208.305528:0:17210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.305555:0:17210:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91780 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.305626:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702720 00000100:00100000:0.0:1789050208.305633:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702720 00000100:00100000:0.0:1789050208.306137:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789050208.306148:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17210:x1875954714702720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050208.306854:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17210:x1875954714702720:12345-0@lo:502:llog_process_th.0 Request processed in 706us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.306862:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789050208.308828:0:17210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17210:1875954714702720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050208.308875:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050208.308890:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050208.308892:0:17210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789050208.308898:0:17210:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789050208.308901:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789050208.308918:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8baabd030000) 00000020:00000080:0.0:1789050208.309042:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789050208.309050:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789050208.309134:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789050208.309141:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df584c4 00000020:00000080:0.0:1789050208.309365:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789050208.309369:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050208.309373:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050208.309374:0:17210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789050208.309388:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050208.309392:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050208.309393:0:17210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789050208.309396:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789050208.309404:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8baabd034d40) 00000020:00000080:0.0:1789050208.309413:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789050208.309416:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789050208.309418:0:17210:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789050208.309421:0:17210:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789050208.309496:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789050208.309544:0:17210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba983e8d000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789050208.309556:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8baabd0319c0) 00000020:00000080:0.0:1789050208.309564:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789050208.309624:0:17210:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789050208.309629:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df584d9 00000020:00000080:0.0:1789050208.309715:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789050208.309721:0:17210:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789050208.309725:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3b8ec5973df584e0 00080000:01000000:0.0:1789050208.309730:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789050208.309733:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df584e7 00010000:00010000:0.0:1789050208.407830:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789050208.408646:0:17210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967536 00000001:00080000:0.0:1789050208.408979:0:17210:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789050208.409648:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8baabd033380) 00000020:00000080:0.0:1789050208.409667:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789050208.409732:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789050208.409738:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df584f5 00000020:00000080:1.0:1789050208.410613:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789050208.419437:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3b8ec5973df584fc 00000020:00000080:2.0:1789050208.421252:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789050208.421266:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.421274:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.421276:0:17210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789050208.421281:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050208.421283:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789050208.421284:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050208.421286:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050208.421287:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050208.421290:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.421291:0:17210:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050208.421302:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.421307:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.421309:0:17210:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789050208.421313:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789050208.421360:0:17210:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789050208.422321:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.422328:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.422330:0:17210:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789050208.422333:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.422337:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.422339:0:17210:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789050208.422341:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789050208.422347:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:00000080:2.0:1789050208.422817:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050208.422844:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8baa857a99c0) 00000020:00000080:2.0:1789050208.423175:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789050208.423184:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789050208.423260:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789050208.423265:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789050208.423275:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df5850a 00010000:00080000:2.0:1789050208.423321:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baaa7dc4000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050208.429839:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789050208.432458:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789050208.432472:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789050208.432572:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789050208.432595:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df58511 00000100:00080000:3.0:1789050208.432606:0:17210:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050208.432617:0:17210:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8baaa7dc4000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050208.432650:0:17210:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae796a00 x1875954714702848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050208.432676:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789050208.432769:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050208.432774:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.432776:0:17210:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789050208.432779:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789050208.432782:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789050208.432783:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050208.432785:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050208.432786:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789050208.432789:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.432790:0:17210:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789050208.432793:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050208.432797:0:17210:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789050208.432800:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.432801:0:17210:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789050208.432804:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789050208.432808:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000100:00100000:0.0:1789050208.432816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714702848:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789050208.432826:0:17210:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789050208.432828:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050208.432849:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8baaae6e19c0) 00000020:00000080:3.0:1789050208.432868:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789050208.432874:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789050208.432884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789050208.432966:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789050208.432971:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789050208.432976:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df5851f 00010000:00080000:3.0:1789050208.433002:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab771c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.142@tcp at head 00000100:00100000:2.0:1789050208.433120:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714702848 00000100:00100000:2.0:1789050208.433127:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714702848 00000100:00100000:2.0:1789050208.433160:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050208.433167:0:17198:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789050208.433168:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714702848:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050208.433174:0:17198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00020000:2.0:1789050208.433181:0:17197:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1789050208.433235:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789050208.439881:0:17210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050208.440601:0:17210:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789050208.442981:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050208.445806:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789050208.455438:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:3.0:1789050208.462044:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789050208.462058:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789050208.462270:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789050208.462290:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df58526 00000100:00080000:3.0:1789050208.462308:0:17210:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050208.462318:0:17210:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8baab771c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050208.462353:0:17210:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae794700 x1875954714702976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050208.462379:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789050208.462491:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050208.462496:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.462498:0:17210:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789050208.462502:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789050208.462567:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789050208.462570:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050208.462572:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050208.462584:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789050208.462587:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.462588:0:17210:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789050208.462590:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050208.462594:0:17210:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789050208.462597:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.462599:0:17210:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789050208.462601:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789050208.462604:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:3.0:1789050208.462624:0:17210:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789050208.462626:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050208.462637:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8baaae6e0000) 00000020:00000080:3.0:1789050208.462648:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789050208.462652:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789050208.462704:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789050208.462710:0:17210:0:(osd_handler.c:8921:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789050208.462715:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3b8ec5973df58534 00010000:00080000:3.0:1789050208.462752:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab0ea1800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.142@tcp at head 00000040:00080000:0.0:1789050208.463010:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789050208.463015:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00010000:3.0:1789050208.463740:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789050208.463797:0:17210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050208.463812:0:17210:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789050208.468416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714702976:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789050208.468475:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714702976 offset 0 length 520: 4 00000040:00080000:0.0:1789050208.473358:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050208.474321:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789050208.475172:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789050208.475615:0:17219:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789050208.475622:0:17219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789050208.476473:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789050208.476485:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789050208.476531:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789050208.476551:0:17210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df5853b 00000100:00080000:3.0:1789050208.476562:0:17210:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050208.476574:0:17210:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8baab0ea1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050208.476610:0:17210:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae794380 x1875954714703104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050208.476639:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789050208.476693:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050208.476704:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.476706:0:17210:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789050208.476710:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050208.476713:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.476715:0:17210:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789050208.476717:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789050208.476719:0:17210:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789050208.476721:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050208.476723:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.476724:0:17210:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789050208.476727:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050208.476729:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050208.476730:0:17210:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789050208.476733:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789050208.476763:0:17210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17210:1875954714703232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.476830:0:17210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.476869:0:17210:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050208.476980:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714703104:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789050208.477013:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703232 00000100:00100000:0.0:1789050208.477019:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703232 00000400:00000100:1.0:1789050208.477020:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714703104 offset 0 length 520: 4 00000100:00100000:0.0:1789050208.477058:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050208.477067:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17210:x1875954714703232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050208.477193:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17210:x1875954714703232:12345-0@lo:502:llog_process_th.0 Request processed in 126us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.477200:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789050208.477312:0:17210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17210:1875954714703232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050208.477338:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050208.477343:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050208.477345:0:17210:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789050208.477348:0:17210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789050208.477728:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789050208.477750:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789050208.477771:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584b6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.477782:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983570200/0x3b8ec5973df584af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df584b6 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050208.477791:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba983e8d000 from 1 10000000:01000000:0.0:1789050208.477794:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050208.477832:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.477840:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.477849:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050208.477874:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050208.477902:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050208.477961:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85157900 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.478215:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703360 00000100:00100000:3.0:1789050208.478220:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703360 00000100:00100000:3.0:1789050208.478259:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050208.478267:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+9:17171:x1875954714703360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050208.478276:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050208.478287:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58542 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.478319:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.478327:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.478335:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602800, rc 0) 00000100:00100000:3.0:1789050208.478380:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+10:17171:x1875954714703360:12345-0@lo:101:mount.lustre.0 Request processed in 113us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.478385:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050208.479115:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050208.479132:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.479142:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.479715:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703488:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789050208.479818:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.479854:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.479956:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703488 00000100:00100000:0.0:1789050208.479964:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703488 00000100:00100000:0.0:1789050208.480003:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789050208.480012:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+10:17171:x1875954714703488:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789050208.480030:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789050208.480036:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789050208.480106:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+10:17171:x1875954714703488:12345-0@lo:256:mount.lustre.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.480113:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050208.481697:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714702848:12345-0@lo:38:llog_process_th.0 Request processed in 48524us (48808us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789050208.481708:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789050208.481761:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050208.481767:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789050208.481771:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714702848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789050208.484458:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703488:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789050208.485706:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789050208.485740:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.485753:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050208.485761:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba983e8d000 from 1 10000000:01000000:1.0:1789050208.485862:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050208.485903:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.485911:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.485921:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.485962:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050208.486020:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.486054:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.486276:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703616 00000100:00100000:0.0:1789050208.486285:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703616 00000100:00100000:0.0:1789050208.486348:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050208.486360:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+10:17171:x1875954714703616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050208.486372:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050208.486385:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58550 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.486408:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.486420:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.486429:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1400, rc 0) 00000100:00100000:0.0:1789050208.486480:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714703616:12345-0@lo:101:mount.lustre.0 Request processed in 123us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.486497:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050208.487302:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050208.487337:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050208.487349:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050208.487416:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050208.487454:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.487485:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.487655:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703744 00000100:00100000:3.0:1789050208.487661:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703744 00000100:00100000:3.0:1789050208.487701:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050208.487710:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714703744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050208.487842:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714703744:12345-0@lo:501:mount.lustre.0 Request processed in 133us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.487859:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050208.488139:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050208.488171:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050208.488213:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050208.488321:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.491671:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714703872 00000100:00100000:3.0:1789050208.491686:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714703872 00000100:00100000:3.0:1789050208.491815:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050208.491826:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714703872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050208.492013:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714703872:12345-0@lo:503:mount.lustre.0 Request processed in 189us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.492021:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050208.492199:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714703872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050208.493863:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17221:1875954714704000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050208.493932:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050208.494003:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa851589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.494129:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704000 00000100:00100000:3.0:1789050208.494136:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704000 00000100:00100000:3.0:1789050208.494179:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789050208.494187:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17221:x1875954714704000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.494758:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17221:x1875954714704000:12345-0@lo:502:llog_process_th.0 Request processed in 570us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.494766:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050208.494875:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17221:1875954714704000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050208.494900:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.494912:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.494914:0:17221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789050208.494921:0:17221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba983e8d000 00000020:00000080:2.0:1789050208.494923:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050208.494931:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.494933:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.494934:0:17221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789050208.494952:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.494955:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.494962:0:17221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789050208.494966:0:17221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba983e8d000 00000020:00000080:2.0:1789050208.494969:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050208.495024:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.495027:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.495029:0:17221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789050208.495031:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.495034:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.495035:0:17221:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050208.495039:0:17221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba983e8d000 00000020:00000080:2.0:1789050208.495041:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050208.495057:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.495059:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.495061:0:17221:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050208.495063:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050208.495066:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.495067:0:17221:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789050208.495070:0:17221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba983e8d000 00000020:00000080:2.0:1789050208.495072:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789050208.495106:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17221:1875954714704128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050208.495144:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050208.495177:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa851589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.496526:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704128 00000100:00100000:3.0:1789050208.496545:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704128 00000100:00100000:3.0:1789050208.496599:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789050208.496608:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17221:x1875954714704128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.496736:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17221:x1875954714704128:12345-0@lo:502:llog_process_th.0 Request processed in 129us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.496744:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050208.497643:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17221:1875954714704128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050208.497679:0:17221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050208.497687:0:17221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050208.497689:0:17221:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789050208.497694:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789050208.498040:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789050208.498063:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050208.498080:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498092:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050208.498144:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789050208.498147:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba983e8d000 10000000:01000000:3.0:1789050208.498150:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba983e8d000 10000000:01000000:3.0:1789050208.498154:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789050208.498159:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba983e8d000 from 1 10000000:01000000:3.0:1789050208.498162:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789050208.498191:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498198:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498216:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050208.498234:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050208.498273:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.498314:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.498329:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704256 00000100:00100000:3.0:1789050208.498335:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704256 00000100:00100000:3.0:1789050208.498365:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789050208.498373:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17171:x1875954714704256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050208.498383:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050208.498393:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603200/0x3b8ec5973df58565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5855e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498414:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603200/0x3b8ec5973df58565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5855e expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498425:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603200/0x3b8ec5973df58565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5855e expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.498432:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603200, rc 0) 00000100:00100000:3.0:1789050208.498464:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714704256:12345-0@lo:101:mount.lustre.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.498470:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789050208.498523:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050208.498535:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58565 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.499922:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58565 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050208.500034:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050208.500082:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.500116:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050208.501677:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704384 00000100:00100000:2.0:1789050208.501689:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704384 00000100:00100000:2.0:1789050208.502349:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050208.502362:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714704384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050208.502565:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714704384:12345-0@lo:501:mount.lustre.0 Request processed in 206us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050208.502573:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050208.504063:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050208.504119:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050208.504175:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050208.504253:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85158000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.507473:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704512 00000100:00100000:3.0:1789050208.507498:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704512 00000100:00100000:3.0:1789050208.507676:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050208.507687:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714704512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050208.507833:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714704512:12345-0@lo:503:mount.lustre.0 Request processed in 148us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.507841:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050208.507987:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714704512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050208.508359:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714704640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050208.508402:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050208.508436:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa851583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.508482:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704640 00000100:00100000:3.0:1789050208.508496:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704640 00000100:00100000:3.0:1789050208.508564:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789050208.508572:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714704640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.508658:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714704640:12345-0@lo:502:llog_process_th.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.508665:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789050208.512374:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714704640:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789050208.512451:0:17225:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789050208.512467:0:17225:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8baa857ab380) 00000020:00000080:2.0:1789050208.512640:0:17225:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789050208.512737:0:17225:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba983e8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789050208.512741:0:17225:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba983e8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789050208.512743:0:17225:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba983e8d000 4 00010000:00080000:2.0:1789050208.512771:0:17225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab42e2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050208.514826:0:17225:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789050208.515122:0:17225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789050208.515158:0:17225:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789050208.515170:0:17225:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3b8ec5973df58573 00000100:00080000:2.0:1789050208.515180:0:17225:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050208.515190:0:17225:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8baab42e2000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050208.515223:0:17225:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2c700 x1875954714704768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050208.515257:0:17225:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789050208.520679:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714704768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050208.520755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.520826:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704768 00000100:00100000:3.0:1789050208.520839:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704768 00000100:00100000:3.0:1789050208.521669:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050208.521677:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714704768:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050208.521745:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714704768:12345-0@lo:38:llog_process_th.0 Request processed in 66us (990us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789050208.521752:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050208.521791:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789050208.521798:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab42e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050208.521802:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789050208.521805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714704768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050208.523067:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714704896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.523138:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.523214:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050208.530205:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714704896 00000100:00100000:1.0:1789050208.530219:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714704896 00000100:00100000:1.0:1789050208.530274:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789050208.530284:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714704896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050208.530459:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714704896:12345-0@lo:502:llog_process_th.0 Request processed in 176us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050208.530468:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050208.530569:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714704896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050208.530639:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714705024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050208.530681:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050208.530706:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.531038:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705024 00000100:00100000:3.0:1789050208.531044:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705024 00000100:00100000:3.0:1789050208.531076:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789050208.531083:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714705024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050208.531164:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17225:x1875954714705024:12345-0@lo:502:llog_process_th.0 Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050208.531171:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789050208.531221:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9e852cd-105e-4a2b-8f2f-088fc33df062:17225:1875954714705024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789050208.531244:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789050208.531481:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789050208.531748:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789050208.531766:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58565 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.531788:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602a00/0x3b8ec5973df5855e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58565 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789050208.531838:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789050208.531839:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789050208.531841:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050208.531842:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050208.531843:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050208.531844:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050208.531846:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789050208.531847:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789050208.531848:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050208.531850:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789050208.531853:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789050208.531856:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789050208.531857:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789050208.531858:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050208.531860:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050208.531861:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050208.531862:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050208.531863:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789050208.531864:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789050208.531865:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050208.531866:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789050208.531884:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789050208.531899:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714705152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789050208.531958:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.531976:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050208.531999:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705152 00000100:00100000:3.0:1789050208.532004:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705152 00000100:00100000:3.0:1789050208.532031:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050208.532038:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714705152:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789050208.532060:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789050208.532077:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789050208.535163:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789050208.535206:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789050208.535850:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17171:x1875954714705152:12345-0@lo:253:mount.lustre.0 Request processed in 3806us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.535863:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1789050208.535932:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789050208.535960:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789050208.535981:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.535997:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.536005:0:17208:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.536045:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.536059:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 11 pid: 17187 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050208.536071:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714705280:0@lo:104: 00000100:00100000:3.0:1789050208.536107:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050208.536138:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050208.536235:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705280 00000100:00100000:0.0:1789050208.536243:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705280 00000100:00100000:0.0:1789050208.536281:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050208.536290:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714705280:12345-0@lo:104: 00010000:00010000:0.0:1789050208.536313:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536365:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050208.536371:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714705280:12345-0@lo:104: Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.536378:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789050208.536398:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050208.536403:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536411:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0a00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050208.536415:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536433:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050208.536446:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050208.536452:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789050208.536476:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536483:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050208.536501:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536509:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58549 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536522:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.536524:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050208.536526:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050208.536673:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714705408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050208.536703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050208.536752:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705408 00000100:00100000:0.0:1789050208.536757:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705408 00010000:00010000:0.0:1789050208.536774:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 12 pid: 17187 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050208.536795:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050208.536801:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3644:x1875954714705408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050208.536810:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050208.536816:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 12 pid: 17187 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536831:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 12 pid: 17187 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536847:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536855:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789050208.536868:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000908193s 00010000:00010000:0.0:1789050208.536872:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536878:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536885:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536891:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536896:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050208.536900:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536908:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536917:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050208.536963:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050208.536992:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3644:x1875954714705408:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050208.537000:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050208.537106:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714705408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050208.537222:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602800/0x3b8ec5973df58549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58542 expref: 11 pid: 17187 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050208.537233:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714705280:0@lo:104: 00010000:00010000:3.0:1789050208.537244:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.537253:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.537259:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050208.537270:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602000/0x3b8ec5973df5857a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050208.537526:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae795500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17171:1875954714705152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050208.537608:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789050208.537613:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050208.537614:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789050208.537615:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050208.537617:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050208.537618:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050208.537619:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050208.537620:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050208.537622:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789050208.537624:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050208.537625:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789050208.537638:0:17171:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1789050208.557771:0:17171:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789050208.558153:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789050208.558218:0:17233:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789050208.558221:0:17233:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789050208.558517:0:17234:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789050208.558803:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789050208.559401:0:17235:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ba981b03800 x1875954714705536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050208.559412:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000040:01000000:2.0:1789050208.559921:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789050208.560005:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050208.560956:0:17234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789050208.561277:0:17171:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789050208.561288:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789050208.561352:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050208.564279:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789050208.565194:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789050208.565238:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789050208.566249:0:17171:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00000040:00080000:3.0:1789050208.568573:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789050208.568984:0:17234:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1789050208.569325:0:17171:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789050208.573766:0:17171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789050208.577321:0:17171:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789050208.577363:0:17171:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaeaec199f988 00100000:10000000:3.0:1789050208.577372:0:17171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789050208.578546:0:17171:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789050208.578564:0:17171:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789050208.578580:0:17171:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789050208.578602:0:17171:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789050208.580482:0:17171:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789050208.580705:0:17171:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789050209.132411:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789050209.577066:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789050209.577075:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba983e8d000 from 7 10000000:01000000:3.0:1789050209.577080:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:0.0:1789050209.577086:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789050209.577132:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050209.577144:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050209.577156:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050209.577181:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714705664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050209.577268:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789050209.577691:0:17229:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050209.577697:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789050209.579599:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba983562480 going to sleep for 11 seconds 00000040:00080000:2.0:1789050209.581854:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789050209.581874:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050209.582611:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705664 00000100:00100000:0.0:1789050209.582624:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705664 00000100:00100000:0.0:1789050209.582685:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789050209.582695:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+11:17189:x1875954714705664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050209.582711:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050209.582731:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58581 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050209.582757:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050209.582768:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050209.582777:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0400, rc 0) 00000100:00100000:0.0:1789050209.582871:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17189:x1875954714705664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (5602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050209.582878:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050209.583126:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714705664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050209.583145:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050209.583154:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050209.583217:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714705792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050209.583254:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050209.583300:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050209.583761:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705792 00000100:00100000:0.0:1789050209.583767:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705792 00000100:00100000:0.0:1789050209.583810:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050209.583818:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17189:x1875954714705792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789050209.583834:0:17187:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789050209.583851:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789050209.583854:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789050209.583981:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17189:x1875954714705792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050209.583989:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789050209.584132:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714705792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789050209.584175:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789050209.584183:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050209.584192:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050210.156180:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050210.601498:0:17229:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050210.601507:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050210.601687:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789050210.601735:0:17229:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050210.601912:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:3.0:1789050210.602467:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050211.177309:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050211.626227:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050212.201170:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050212.283246:0:17477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789050212.649089:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000020:00000004:0.0:1789050213.063001:0:17529:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789050213.063309:0:17529:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789050213.225307:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050213.676218:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000020:00000004:0.0:1789050213.789899:0:17580:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789050213.790319:0:17580:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789050213.993395:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714705920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050213.993492:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050213.993848:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705920 00000100:00100000:1.0:1789050213.993856:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705920 00000100:00100000:1.0:1789050213.993916:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050213.993927:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3645:x1875954714705920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789050213.995016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789050213.995025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789050213.995030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050213.995036:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:0.0:1789050213.995042:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050213.995054:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8baaa7dc4000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789050213.995090:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba981b02d80 x1875954714706048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050213.995128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050213.995132:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050213.995135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050213.995138:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050213.995141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789050213.995144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789050213.995146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baab42e2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050213.995153:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8baab42e2000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789050213.995166:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba981b03100 x1875954714706176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050213.995251:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706048:0@lo:38:kworker.0 00000100:00100000:2.0:1789050213.995316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050213.995350:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706048 00000100:00100000:2.0:1789050213.995359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714706176:0@lo:38:kworker.0 00000100:00100000:0.0:1789050213.995359:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706048 00000100:00100000:0.0:1789050213.995398:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050213.995415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050213.995687:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714706048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789050213.995706:0:17198:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789050213.995727:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3645:x1875954714705920:12345-0@lo:400:kworker.0 Request processed in 1799us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050213.995740:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050213.995796:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706176 00000100:00100000:1.0:1789050213.995800:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706176 00000100:00100000:1.0:1789050213.995820:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050213.995826:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714706176:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789050213.995842:0:17194:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1789050213.995873:0:17194:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3b8ec5973df5858f 00000004:00100000:1.0:1789050213.995887:0:17194:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789050213.996040:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8ba9834d7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050213.996087:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875954714706176:12345-0@lo:38:kworker.0 Request processed in 259us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050213.996093:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789050213.996231:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba981b03100 x1875954714706176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789050213.996246:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789050213.996254:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789050213.996269:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789050213.996271:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab42e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789050213.996277:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875954714706176:0@lo:38:kworker.0 00000100:00100000:3.0:1789050213.997563:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714705920:0@lo:400:kworker.0 00000100:00100000:1.0:1789050214.017149:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714706048:12345-0@lo:38:kworker.0 Request processed in 21455us (21824us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050214.017168:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789050214.017610:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050214.017617:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050214.017622:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706048:0@lo:38:kworker.0 00010000:00010000:0.0:1789050214.249628:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050214.697206:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050215.276354:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050215.721475:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050216.306098:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050216.749389:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050217.321316:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050217.769061:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000100:00100000:0.0:1789050218.090360:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050208/real 1789050208] req@ffff8baaae794380 x1875954714703104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050218.090392:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8baaae794380 x1875954714703104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050218.090403:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050208/real 1789050208] req@ffff8baaae794700 x1875954714702976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050218.090414:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8baaae794700 x1875954714702976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050218.090432:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050218.090456:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050218.090460:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714703104:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789050218.090466:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050218.090471:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050218.090474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714702976:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789050218.090714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789050218.090718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789050218.090721:0:37:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050218.090726:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789050218.090731:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789050218.090741:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8baaa7dc4000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050218.090762:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2ea00 x1875954714706432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050218.090777:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050218.090780:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789050218.090782:0:37:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050218.090785:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1789050218.090787:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789050218.090792:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8baab771c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050218.090802:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2d180 x1875954714706560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050218.090828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050218.090831:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789050218.090833:0:37:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050218.090836:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1789050218.090838:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789050218.090843:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8baab0ea1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050218.090856:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2d880 x1875954714706688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050218.090884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706432:0@lo:38:kworker.0 00000100:00100000:2.0:1789050218.090967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050218.091033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706560:0@lo:8:kworker.0 00000400:00000100:2.0:1789050218.091055:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714706560 offset 0 length 520: 4 00000100:00100000:2.0:1789050218.091073:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706688:0@lo:8:kworker.0 00000400:00000100:2.0:1789050218.091092:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714706688 offset 0 length 520: 4 00000100:00100000:0.0:1789050218.091185:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714706816:0@lo:400:kworker.0 00000100:00100000:0.0:1789050218.091220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050218.091257:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050218.091264:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714706304:0@lo:400:kworker.0 00000100:00100000:0.0:1789050218.091291:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050218.091320:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706304 00000100:00100000:0.0:1789050218.091327:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706304 00000100:00100000:0.0:1789050218.091366:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789050218.091375:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3647:x1875954714706304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050218.091433:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:3647:x1875954714706304:12345-0@lo:400:kworker.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050218.091440:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789050218.091480:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714706304:0@lo:400:kworker.0 00000100:00100000:2.0:1789050218.091565:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706816 00000100:00100000:2.0:1789050218.091570:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706816 00000100:00100000:2.0:1789050218.091605:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050218.091612:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714706816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050218.091652:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714706816:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050218.091658:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789050218.091689:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba983f2e300 x1875954714706816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050218.091699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714706816:0@lo:400:kworker.0 00000100:00100000:3.0:1789050218.092078:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706432 00000100:00100000:3.0:1789050218.092083:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706432 00000100:00100000:3.0:1789050218.092105:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050218.092111:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714706432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789050218.092126:0:17197:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789050218.116361:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714706432:12345-0@lo:38:kworker.0 Request processed in 24239us (25383us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789050218.116377:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789050218.116431:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050218.116443:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050218.116449:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706432:0@lo:38:kworker.0 00010000:00010000:0.0:1789050218.345089:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050218.796657:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050219.369144:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789050219.484036:0:17924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789050219.484040:0:17924:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789050219.484041:0:17924:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789050219.484145:0:17924:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba9834d3800 00000020:01000004:1.0:1789050219.484160:0:17924:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789050219.484171:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789050219.484184:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8baab77f19c0) 00000020:00000080:1.0:1789050219.484198:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789050219.566449:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789050219.571583:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789050219.576418:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789050219.576763:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789050219.577543:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789050219.578623:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789050219.579012:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789050219.579303:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789050219.579680:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.580280:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.580651:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.586702:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.587380:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.587762:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.588436:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.588709:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.592892:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.593728:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.595978:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.599972:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.600901:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789050219.602912:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789050219.603883:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789050219.610208:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789050219.611444:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789050219.612688:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.615665:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.616545:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.616824:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.617326:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789050219.618147:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.618550:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.619598:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789050219.619971:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789050219.623846:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789050219.624082:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789050219.624569:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789050219.625579:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789050219.626007:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789050219.626304:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789050219.626670:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789050219.626910:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789050219.627144:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789050219.627398:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789050219.627674:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789050219.628039:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:01000000:2.0:1789050219.628851:0:17924:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789050219.629157:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789050219.629168:0:17924:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789050219.629180:0:17924:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df5859d 00000020:01000004:2.0:1789050219.629187:0:17924:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789050219.629208:0:17924:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789050219.629211:0:17924:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789050219.629230:0:17924:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789050219.629257:0:17924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789050219.629261:0:17924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789050219.638454:0:17924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789050219.638559:0:17924:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789050219.638564:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789050219.638566:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.638567:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.638572:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.638574:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.638575:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.638576:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.638577:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.638578:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050219.638582:0:17924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789050219.638584:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050219.638585:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.638586:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.638587:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.638588:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.638589:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.638590:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.638591:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.638592:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050219.638627:0:17924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789050219.638648:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714706944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050219.638714:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.638783:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.639511:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714706944 00000100:00100000:1.0:1789050219.639520:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714706944 00000100:00100000:1.0:1789050219.639574:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050219.639588:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17924:x1875954714706944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050219.639619:0:17185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789050219.639622:0:17185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789050219.639629:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789050219.640088:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17924:x1875954714706944:12345-0@lo:253:mount.lustre.0 Request processed in 505us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.640097:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050219.640180:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714706944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050219.640191:0:17924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789050219.640193:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050219.640194:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.640196:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.640197:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.640198:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.640199:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.640200:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.640201:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.640202:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789050219.640231:0:17924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba9834d3800 from lustre-MDT0001 10000000:01000000:2.0:1789050219.640258:0:17924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789050219.640260:0:17924:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789050219.640267:0:17924:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857acd40 local copy 00010000:00010000:2.0:1789050219.640277:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.640588:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050219.640629:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.640718:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.641933:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707072 00000100:00100000:0.0:1789050219.642011:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707072 00000100:00100000:0.0:1789050219.642097:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050219.642106:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17924:x1875954714707072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.642262:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17924:x1875954714707072:12345-0@lo:501:mount.lustre.0 Request processed in 157us (1632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050219.642269:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789050219.642476:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789050219.642496:0:17924:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789050219.642517:0:17924:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789050219.642526:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.642538:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050219.642567:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba9834d3800 10000000:01000000:2.0:1789050219.642572:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789050219.642577:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8baa857acd40 10000000:01000000:2.0:1789050219.642579:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789050219.642582:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8baa857acd40 from 1 10000000:01000000:2.0:1789050219.642585:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789050219.642614:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.642622:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.642631:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.642660:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050219.642710:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.642895:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.643132:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707200 00000100:00100000:0.0:1789050219.643141:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707200 00000100:00100000:0.0:1789050219.643231:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789050219.643241:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+12:17924:x1875954714707200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.643252:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050219.643265:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0800/0x3b8ec5973df585ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df585a4 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.643285:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0800/0x3b8ec5973df585ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df585a4 expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.643294:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0800/0x3b8ec5973df585ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df585a4 expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.643302:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0800, rc 0) 00000100:00100000:0.0:1789050219.643356:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+13:17924:x1875954714707200:12345-0@lo:101:mount.lustre.0 Request processed in 108us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.643362:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050219.643432:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.643447:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585ab expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.643476:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df585ab expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050219.643495:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789050219.643506:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585ab expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.643513:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694400/0x3b8ec5973df585a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585ab expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050219.643522:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ba9834d3800 10000000:01000000:3.0:1789050219.643534:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789050219.643538:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ba9834d3800 from 1 10000000:01000000:3.0:1789050219.643540:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789050219.643558:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.643566:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.643573:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.643598:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050219.643628:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.644165:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8558d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.644232:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707328 00000100:00100000:2.0:1789050219.644238:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707328 00000100:00100000:2.0:1789050219.644266:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789050219.644273:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+13:17924:x1875954714707328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.644281:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050219.644293:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae694e00/0x3b8ec5973df585b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df585b2 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.644309:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694e00/0x3b8ec5973df585b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df585b2 expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.644318:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae694e00/0x3b8ec5973df585b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df585b2 expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.644325:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694e00, rc 0) 00000100:00100000:2.0:1789050219.644410:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+14:17924:x1875954714707328:12345-0@lo:101:mount.lustre.0 Request processed in 137us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.644416:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789050219.644653:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.644665:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585b9 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.644683:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df585b9 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050219.644698:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789050219.645071:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585b9 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.645080:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603400/0x3b8ec5973df585b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585b9 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050219.645087:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789050219.645092:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789050219.645097:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ba9834d3800 10000000:01000000:3.0:1789050219.645100:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789050219.645104:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789050219.645106:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789050219.645129:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.645136:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.645143:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.645161:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050219.645199:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.645234:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8558d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.645308:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707456 00000100:00100000:0.0:1789050219.645314:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707456 00000100:00100000:0.0:1789050219.645361:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789050219.645370:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+14:17924:x1875954714707456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.645389:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050219.645399:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1200/0x3b8ec5973df585c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df585c0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.645416:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1200/0x3b8ec5973df585c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df585c0 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.645425:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1200/0x3b8ec5973df585c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df585c0 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.645432:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1200, rc 0) 00000100:00100000:0.0:1789050219.645477:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707456:12345-0@lo:101:mount.lustre.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.645483:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789050219.645678:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.645690:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585c7 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.645698:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df585c7 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050219.647394:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789050219.648287:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050219.658264:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789050219.658325:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789050219.658339:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789050219.658545:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789050219.658568:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789050219.658582:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789050219.658596:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789050219.658609:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789050219.658621:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789050219.658633:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789050219.658646:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789050219.658658:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789050219.659545:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789050219.659586:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789050219.659601:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789050219.659618:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789050219.659631:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789050219.659645:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789050219.659658:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789050219.659759:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789050219.659934:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789050219.660032:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789050219.660048:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789050219.660098:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789050219.660104:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789050219.660212:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.660293:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.660335:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baabd126b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.660371:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707584 00000100:00100000:1.0:1789050219.660380:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707584 00000100:00100000:1.0:1789050219.660432:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789050219.660440:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050219.660575:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707584:12345-0@lo:501:mount.lustre.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.660583:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789050219.661591:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.661633:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050219.662032:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.662063:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baabd126b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.662125:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707712 00000100:00100000:0.0:1789050219.662132:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707712 00000100:00100000:0.0:1789050219.662208:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050219.662230:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050219.665605:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707712:12345-0@lo:503:mount.lustre.0 Request processed in 3379us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.665619:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789050219.665740:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050219.666210:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050219.666298:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050219.666348:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.666391:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baabd126b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.666480:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707840 00000100:00100000:2.0:1789050219.666488:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707840 00000100:00100000:2.0:1789050219.666635:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789050219.666647:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050219.667629:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707840:12345-0@lo:502:mount.lustre.0 Request processed in 979us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.667639:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050219.667915:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050219.668435:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789050219.668550:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789050219.668569:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789050219.668584:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789050219.668597:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789050219.668612:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789050219.668638:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789050219.668650:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789050219.668662:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789050219.668686:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789050219.668705:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789050219.668735:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789050219.668751:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789050219.668766:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789050219.669018:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789050219.669035:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789050219.669048:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789050219.669061:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789050219.669073:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789050219.669086:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789050219.669097:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789050219.669106:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789050219.669116:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789050219.669128:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789050219.669156:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789050219.669169:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789050219.669180:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789050219.669190:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789050219.669199:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789050219.669209:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789050219.669233:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789050219.669247:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789050219.669259:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789050219.669277:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789050219.669288:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789050219.669298:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789050219.669309:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789050219.669321:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789050219.669332:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789050219.669352:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789050219.669375:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789050219.669388:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789050219.669401:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789050219.669416:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789050219.669456:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050219.671859:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.671913:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.673298:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714707968 00000100:00100000:2.0:1789050219.673326:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714707968 00000100:00100000:2.0:1789050219.673448:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789050219.673525:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.673933:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714707968:12345-0@lo:502:mount.lustre.0 Request processed in 476us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.673969:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789050219.675337:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714707968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050219.675438:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789050219.675453:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789050219.676392:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.676404:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.676407:0:17928:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789050219.676414:0:17928:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789050219.676417:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050219.676431:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8baaae6e4d40) 00000020:00000080:3.0:1789050219.676459:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789050219.676465:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789050219.678296:0:17928:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789050219.678315:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df585d5 00000020:00000080:3.0:1789050219.678545:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789050219.678553:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.678558:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.678560:0:17928:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789050219.678563:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.678568:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.678569:0:17928:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789050219.678573:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050219.678598:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8baabeefb380) 00000020:00000080:3.0:1789050219.678613:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789050219.678618:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789050219.678620:0:17928:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789050219.678623:0:17928:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789050219.678628:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789050219.678686:0:17928:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba9834d3800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789050219.678698:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8baabeefcd40) 00000020:00000080:3.0:1789050219.678705:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789050219.678776:0:17928:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789050219.678782:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df585ea 00000020:00000080:3.0:1789050219.679153:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789050219.679178:0:17928:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789050219.679184:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x3b8ec5973df585f1 00080000:01000000:3.0:1789050219.679190:0:17928:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789050219.679194:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df585f8 00000100:00100000:0.0:1789050219.817050:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789050219.841929:0:17928:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789050219.842841:0:17928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789050219.843224:0:17928:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789050219.849332:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789050219.849345:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050219.849352:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050219.849355:0:17928:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789050219.849359:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050219.849365:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050219.849367:0:17928:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789050219.849370:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789050219.849376:0:17928:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:00000080:1.0:1789050219.849404:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050219.849420:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8baab77f3380) 00000020:00000080:1.0:1789050219.849441:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789050219.849446:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789050219.849537:0:17928:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789050219.849545:0:17928:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789050219.849552:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df58606 00010000:00080000:1.0:1789050219.849593:0:17928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab7854000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050219.852434:0:17928:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789050219.853974:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789050219.853990:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789050219.854028:0:17928:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789050219.854051:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df5860d 00000100:00080000:2.0:1789050219.854062:0:17928:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050219.854073:0:17928:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8baab7854000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050219.854108:0:17928:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2ce00 x1875954714708096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050219.854145:0:17928:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789050219.854207:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050219.854211:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854213:0:17928:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789050219.854227:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050219.854230:0:17928:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789050219.854232:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.854234:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.854235:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050219.854238:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854239:0:17928:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050219.854241:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050219.854245:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854247:0:17928:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789050219.854250:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789050219.854290:0:17928:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789050219.854304:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050219.854307:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854309:0:17928:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789050219.854312:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050219.854313:0:17928:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789050219.854315:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.854316:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.854318:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050219.854320:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854321:0:17928:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050219.854324:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050219.854327:0:17928:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789050219.854331:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.854332:0:17928:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789050219.854335:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789050219.854339:0:17928:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:2.0:1789050219.854359:0:17928:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789050219.854361:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050219.854373:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8baa857a8000) 00000100:00080000:1.0:1789050219.854378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789050219.854383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:00000080:2.0:1789050219.854385:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00080000:1.0:1789050219.854385:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:2.0:1789050219.854389:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1789050219.854389:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789050219.854393:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789050219.854398:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8baaa7dc4000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050219.854411:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a0700 x1875954714708352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050219.854420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.854423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050219.854425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.854432:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:2.0:1789050219.854449:0:17928:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789050219.854455:0:17928:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789050219.854474:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df5861b 00010000:00080000:2.0:1789050219.854500:0:17928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baab9998000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050219.854694:0:17928:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789050219.855316:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708096:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050219.855382:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.855442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714708352:0@lo:38:kworker.0 00000100:00100000:3.0:1789050219.855465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.855515:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714708480:0@lo:400:kworker.0 00000100:00100000:3.0:1789050219.855543:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.855564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714708224:0@lo:400:kworker.0 00000100:00100000:3.0:1789050219.855575:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708480 00000100:00100000:3.0:1789050219.855582:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708480 00000100:00100000:0.0:1789050219.855595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.855617:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050219.855626:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714708480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050219.855629:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708224 00000100:00100000:0.0:1789050219.855632:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708224 00000100:00100000:0.0:1789050219.855655:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789050219.855661:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:3644:x1875954714708224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050219.855672:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714708480:12345-0@lo:400:kworker.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.855679:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050219.855689:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:3644:x1875954714708224:12345-0@lo:400:kworker.0 Request processed in 29us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.855695:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789050219.855712:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8baab78a2680 x1875954714708480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050219.855725:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714708480:0@lo:400:kworker.0 00000100:00100000:0.0:1789050219.855725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714708224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050219.856234:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708096 00000100:00100000:2.0:1789050219.856239:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708096 00000100:00100000:2.0:1789050219.856259:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708352 00000100:00100000:2.0:1789050219.856262:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708352 00000100:00100000:2.0:1789050219.856271:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050219.856282:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875954714708096:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789050219.856305:0:17216:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1789050219.856338:0:17216:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df58622 00000004:00100000:2.0:1789050219.856353:0:17216:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789050219.856358:0:17216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789050219.856430:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050219.856435:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714708352:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789050219.856487:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875954714708352:12345-0@lo:38:kworker.0 Request processed in 50us (1021us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789050219.856494:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050219.856522:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050219.856529:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050219.856533:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789050219.856537:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714708352:0@lo:38:kworker.0 00000040:01000000:3.0:1789050219.857587:0:17928:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050219.858351:0:17928:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789050219.862844:0:17216:0:(import.c:65:import_set_state_nolock()) ffff8baa90bd6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050219.862985:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714708096:12345-0@lo:38:llog_process_th.0 Request processed in 6699us (7600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.862995:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050219.863123:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050219.863133:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789050219.863142:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789050219.863147:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789050219.863150:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab7854000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789050219.863167:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789050219.863456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714708608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050219.863497:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.864713:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708608 00000100:00100000:3.0:1789050219.864724:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708608 00000100:00100000:3.0:1789050219.864782:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050219.864791:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875954714708608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050219.864823:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050219.864894:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875954714708608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.864902:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050219.867056:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714708608:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789050219.868442:0:17928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050219.869228:0:17928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789050219.869401:0:17928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789050219.870711:0:17933:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050219.870716:0:17933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789050219.878375:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789050219.878392:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789050219.878438:0:17928:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789050219.878460:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df58629 00000100:00080000:2.0:1789050219.878470:0:17928:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050219.878482:0:17928:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8baab9998000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050219.878517:0:17928:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2ed80 x1875954714708736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050219.878552:0:17928:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789050219.878613:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050219.878617:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.878619:0:17928:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789050219.878622:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050219.878625:0:17928:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1789050219.878626:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.878628:0:17928:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.878630:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050219.878632:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.878634:0:17928:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050219.878636:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050219.878640:0:17928:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789050219.878643:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.878644:0:17928:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789050219.878647:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789050219.878651:0:17928:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:2.0:1789050219.878672:0:17928:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789050219.878675:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050219.878700:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8baabd1799c0) 00000020:00000080:2.0:1789050219.878713:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789050219.878718:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1789050219.878723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.878728:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050219.878730:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.878733:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:2.0:1789050219.878770:0:17928:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789050219.878777:0:17928:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789050219.878784:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3b8ec5973df58637 00000100:00100000:3.0:1789050219.878809:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708736:0@lo:8:llog_process_th.0 00010000:00080000:2.0:1789050219.878810:0:17928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baa85745000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.142@tcp at head 00000400:00000100:3.0:1789050219.878860:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714708736 offset 0 length 520: 4 00010000:00010000:2.0:1789050219.879099:0:17928:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789050219.879166:0:17928:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789050219.879182:0:17928:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789050219.886000:0:17928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050219.886528:0:17928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789050219.886650:0:17928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789050219.887389:0:17935:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050219.887394:0:17935:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789050219.889115:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789050219.889305:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789050219.889377:0:17928:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789050219.889403:0:17928:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df5863e 00000100:00080000:3.0:1789050219.889414:0:17928:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050219.889426:0:17928:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050219.889467:0:17928:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaae796d80 x1875954714708864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050219.889499:0:17928:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789050219.889601:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708864:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789050219.889649:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714708864 offset 0 length 520: 4 00000020:01000000:3.0:1789050219.889748:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.889752:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.889754:0:17928:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789050219.889757:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.889761:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.889762:0:17928:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789050219.889765:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789050219.889767:0:17928:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789050219.889769:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.889771:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.889773:0:17928:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789050219.889775:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.889777:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.889778:0:17928:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789050219.889781:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789050219.889819:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.889822:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.889824:0:17928:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789050219.889827:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1789050219.890024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.890029:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050219.890032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050219.890035:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789050219.890379:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789050219.890413:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789050219.890437:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585c7 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.890449:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602000/0x3b8ec5973df585c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df585c7 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050219.890456:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba9834d3800 from 1 10000000:01000000:2.0:1789050219.890459:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789050219.890483:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.890504:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.890516:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.890534:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714708992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050219.890576:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.890649:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.893055:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714708992 00000100:00100000:1.0:1789050219.893073:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714708992 00000100:00100000:1.0:1789050219.893275:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789050219.893287:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+15:17924:x1875954714708992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050219.893305:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050219.893325:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58645 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.893364:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.893376:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.893385:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570e00, rc 0) 00000100:00100000:1.0:1789050219.893463:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17924:x1875954714708992:12345-0@lo:101:mount.lustre.0 Request processed in 179us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.893481:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789050219.893574:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714708992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.893594:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.893604:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.894232:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709120:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789050219.894281:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.895245:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709120 00000100:00100000:0.0:1789050219.895266:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709120 00000100:00100000:0.0:1789050219.895304:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789050219.895313:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17924:x1875954714709120:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789050219.895335:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789050219.895366:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789050219.895370:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789050219.895459:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17924:x1875954714709120:12345-0@lo:256:mount.lustre.0 Request processed in 147us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.895467:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050219.895637:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.895659:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709120:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789050219.897279:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050219.897435:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.897464:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050219.897473:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba9834d3800 from 1 10000000:01000000:3.0:1789050219.897477:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050219.897513:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.897521:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.897531:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.897555:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050219.897615:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.897658:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.897729:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709248 00000100:00100000:0.0:1789050219.897737:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709248 00000100:00100000:0.0:1789050219.897789:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050219.897809:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17924:x1875954714709248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.897821:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050219.897834:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58653 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.897857:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.897869:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.897877:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0000, rc 0) 00000100:00100000:0.0:1789050219.898113:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709248:12345-0@lo:101:mount.lustre.0 Request processed in 315us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.898132:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050219.898314:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.898329:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.898338:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050219.898531:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050219.898562:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.898590:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.898668:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.898723:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709376 00000100:00100000:0.0:1789050219.898730:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709376 00000100:00100000:0.0:1789050219.898811:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789050219.898818:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.898955:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709376:12345-0@lo:501:mount.lustre.0 Request processed in 120us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.898962:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050219.899240:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.899269:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050219.899311:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.899436:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709504 00000100:00100000:1.0:1789050219.899441:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709504 00000100:00100000:1.0:1789050219.899477:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050219.899485:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050219.899561:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709504:12345-0@lo:503:mount.lustre.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.899568:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789050219.899666:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.899681:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050219.900117:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050219.900280:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050219.900319:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.900342:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.900514:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709632 00000100:00100000:1.0:1789050219.900520:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709632 00000100:00100000:1.0:1789050219.900555:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050219.900563:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050219.900650:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709632:12345-0@lo:502:mount.lustre.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.900658:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789050219.901059:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050219.901337:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789050219.901379:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789050219.901394:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789050219.901407:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789050219.901421:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789050219.901435:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789050219.901448:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789050219.901461:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789050219.901475:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789050219.901490:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789050219.901503:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789050219.901528:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050219.901567:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.901590:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.901706:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709760 00000100:00100000:1.0:1789050219.901711:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709760 00000100:00100000:1.0:1789050219.902006:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789050219.902016:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050219.902207:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709760:12345-0@lo:502:mount.lustre.0 Request processed in 192us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.902224:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050219.902352:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050219.902404:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789050219.902419:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789050219.903056:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.903065:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903067:0:17937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789050219.903074:0:17937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba9834d3800 00000020:00000080:3.0:1789050219.903076:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050219.903084:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.903086:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903087:0:17937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789050219.903090:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.903092:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903093:0:17937:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789050219.903097:0:17937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba9834d3800 00000020:00000080:3.0:1789050219.903099:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050219.903157:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.903160:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903162:0:17937:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789050219.903164:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.903167:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903168:0:17937:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050219.903172:0:17937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba9834d3800 00000020:00000080:3.0:1789050219.903174:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050219.903192:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.903195:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903197:0:17937:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050219.903200:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.903202:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903204:0:17937:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789050219.903207:0:17937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba9834d3800 00000020:00000080:3.0:1789050219.903209:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050219.903255:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.903258:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.903260:0:17937:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789050219.903262:0:17937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789050219.915677:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789050219.915724:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050219.915751:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.915766:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050219.915834:0:17924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789050219.915837:0:17924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba9834d3800 10000000:01000000:0.0:1789050219.915841:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba9834d3800 10000000:01000000:0.0:1789050219.915845:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789050219.915851:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba9834d3800 from 1 10000000:01000000:0.0:1789050219.915854:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789050219.915888:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.915897:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.915909:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.915934:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050219.917306:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.918450:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714709888 00000100:00100000:0.0:1789050219.918461:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714709888 00000100:00100000:0.0:1789050219.918513:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789050219.918522:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17924:x1875954714709888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.918539:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050219.918556:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1e00/0x3b8ec5973df58668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58661 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.918583:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1e00/0x3b8ec5973df58668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58661 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.918593:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1e00/0x3b8ec5973df58668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58661 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.918602:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1e00, rc 0) 00000100:00100000:0.0:1789050219.918649:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714709888:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.918656:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789050219.918702:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa867b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.918723:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714709888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.918741:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58668 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.918750:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58668 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050219.926294:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789050219.926627:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050219.926834:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789050219.926860:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789050219.926876:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789050219.926890:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789050219.926904:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789050219.926918:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789050219.926931:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789050219.928918:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789050219.929456:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789050219.929476:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789050219.929493:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789050219.929509:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789050219.929526:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789050219.929542:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789050219.929559:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789050219.929571:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789050219.929582:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789050219.929594:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789050219.929609:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789050219.929626:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789050219.929642:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789050219.929658:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789050219.929673:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789050219.929698:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789050219.929715:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789050219.929732:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789050219.929755:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789050219.929767:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789050219.929789:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789050219.929794:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789050219.930541:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.930620:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.932273:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa867b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.937649:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710016 00000100:00100000:2.0:1789050219.937667:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710016 00000100:00100000:2.0:1789050219.939593:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789050219.939610:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050219.939781:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710016:12345-0@lo:501:mount.lustre.0 Request processed in 176us (9160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.939790:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789050219.941895:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050219.943088:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050219.943457:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.943494:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.943613:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710144 00000100:00100000:1.0:1789050219.943621:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710144 00000100:00100000:1.0:1789050219.943664:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050219.943673:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050219.943793:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710144:12345-0@lo:503:mount.lustre.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.943891:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789050219.944275:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789050219.944731:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789050219.944814:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.944859:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.944899:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.945031:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710272 00000100:00100000:0.0:1789050219.945038:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710272 00000100:00100000:0.0:1789050219.945073:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050219.945083:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050219.945182:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710272:12345-0@lo:502:mount.lustre.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.945189:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050219.945350:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050219.945524:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789050219.945551:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789050219.945566:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789050219.945579:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789050219.945604:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789050219.945618:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789050219.945631:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789050219.945645:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789050219.945657:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789050219.945671:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789050219.945685:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789050219.945700:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789050219.945714:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789050219.945726:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789050219.945738:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789050219.945750:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789050219.945761:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789050219.945773:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789050219.945785:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789050219.945807:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789050219.945831:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789050219.945845:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789050219.945856:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789050219.945869:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789050219.945881:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789050219.945894:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789050219.945906:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789050219.945918:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789050219.945930:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789050219.945978:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789050219.945993:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789050219.946006:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789050219.946020:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789050219.946034:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789050219.946047:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789050219.946061:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789050219.946085:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789050219.946100:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789050219.946113:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789050219.946587:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789050219.946607:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789050219.946622:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789050219.946635:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789050219.946650:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789050219.946662:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789050219.946679:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789050219.946692:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789050219.946704:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789050219.946746:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.946800:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.946823:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.946853:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710400 00000100:00100000:2.0:1789050219.946860:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710400 00000100:00100000:2.0:1789050219.946907:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050219.946916:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.947034:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710400:12345-0@lo:502:mount.lustre.0 Request processed in 119us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.947042:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050219.947091:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050219.951772:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789050219.951823:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789050219.951872:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.951970:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.952021:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710528 00000100:00100000:2.0:1789050219.952029:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710528 00000100:00100000:2.0:1789050219.952088:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050219.952097:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050219.953562:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710528:12345-0@lo:502:mount.lustre.0 Request processed in 1461us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.953573:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050219.953642:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa88682d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.953667:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050219.953735:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789050219.953749:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789050219.955058:0:17943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789050219.955078:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8baabd17b380) 00000020:00000080:2.0:1789050219.955102:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789050219.956053:0:17943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba9834d3800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789050219.956061:0:17943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba9834d3800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789050219.956064:0:17943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba9834d3800 3 00010000:00080000:2.0:1789050219.956109:0:17943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baa85741000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050219.963644:0:17943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789050219.963952:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789050219.963997:0:17943:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789050219.964010:0:17943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x3b8ec5973df58676 00000100:00080000:2.0:1789050219.964020:0:17943:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050219.964032:0:17943:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8baa85741000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050219.964066:0:17943:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2dc00 x1875954714710656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050219.964102:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714710656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789050219.965465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.965544:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710656 00000100:00100000:2.0:1789050219.965553:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710656 00000100:00100000:2.0:1789050219.965595:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050219.965604:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714710656:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789050219.965631:0:17194:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1789050219.965677:0:17194:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3b8ec5973df5867d 00000004:00100000:2.0:1789050219.965694:0:17194:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789050219.965728:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8baab4111000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050219.965779:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875954714710656:12345-0@lo:38:llog_process_th.0 Request processed in 175us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.965787:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789050219.966249:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba983f2dc00 x1875954714710656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050219.966274:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050219.966282:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789050219.966289:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789050219.966294:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789050219.966297:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85741000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789050219.966303:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875954714710656:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789050219.966323:0:17943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789050219.971621:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789050219.971679:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789050219.971710:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789050219.971728:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58668 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.971740:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa86db0a00/0x3b8ec5973df58661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58668 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789050219.971790:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789050219.971792:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.971794:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.971795:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.974674:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.974683:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.974684:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.974686:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.974687:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050219.974692:0:17924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789050219.974695:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050219.974697:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.974698:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.974699:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.974708:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.974709:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.974710:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.974711:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.974713:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050219.974739:0:17924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789050219.974761:0:17924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050219.974831:0:17924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.974876:0:17924:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa886823c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789050219.975307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050219.975313:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050219.975316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050219.975318:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050219.975523:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710784 00000100:00100000:0.0:1789050219.975532:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710784 00000100:00100000:0.0:1789050219.975576:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789050219.975586:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050219.975614:0:17185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789050219.975627:0:17185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789050219.977582:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789050219.977616:0:17185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789050219.977630:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789050219.978022:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789050219.978027:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789050219.978050:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.978068:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.978075:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.978082:0:17208:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.978696:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17924:x1875954714710784:12345-0@lo:253:mount.lustre.0 Request processed in 3108us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.978707:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789050219.978789:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.978805:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 17 pid: 17185 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.978820:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714710912:0@lo:104: 00000100:00100000:2.0:1789050219.978855:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050219.978904:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.978924:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 17 pid: 17186 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.978932:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714711040:0@lo:104: 00000100:00100000:2.0:1789050219.978982:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.979002:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa867b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.979040:0:17924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:17924:1875954714710784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050219.979051:0:17924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789050219.979054:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050219.979056:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789050219.979057:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050219.979059:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050219.979060:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050219.979061:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050219.979063:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050219.979064:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050219.979066:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789050219.979078:0:17924:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789050219.982391:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714710912 00000100:00100000:1.0:1789050219.982405:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714710912 00000100:00100000:1.0:1789050219.982447:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711040 00000100:00100000:1.0:1789050219.982451:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711040 00000100:00100000:1.0:1789050219.982465:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050219.982474:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:17208:x1875954714710912:12345-0@lo:104: 00010000:00010000:1.0:1789050219.982491:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982584:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050219.982590:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:17208:x1875954714710912:12345-0@lo:104: Request processed in 117us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.982597:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050219.982612:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050219.982619:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714711040:12345-0@lo:104: 00010000:00010000:1.0:1789050219.982626:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982659:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789050219.982665:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714711040:12345-0@lo:104: Request processed in 47us (3683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.982671:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050219.982712:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714710912:0@lo:104: 00000100:00100000:1.0:1789050219.982721:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714711040:0@lo:104: 00010000:00010000:1.0:1789050219.982762:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982779:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050219.982784:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982791:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050219.982795:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982802:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050219.982809:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050219.982814:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789050219.982846:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982853:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050219.982872:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982879:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5864c expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982891:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050219.982894:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982909:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603e00 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050219.982912:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982919:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050219.982924:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050219.982930:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789050219.982964:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982970:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050219.982987:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.982993:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603e00/0x3b8ec5973df58581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58588 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983005:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050219.983007:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050219.983008:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050219.983014:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050219.983032:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714711168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050219.983066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.983104:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714711296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050219.983153:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.983191:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711168 00000100:00100000:1.0:1789050219.983195:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711168 00010000:00010000:1.0:1789050219.983225:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 18 pid: 17185 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.983245:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711296 00000100:00100000:1.0:1789050219.983248:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711296 00010000:00010000:1.0:1789050219.983258:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 19 pid: 17186 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.983269:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050219.983276:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:3647:x1875954714711168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050219.983285:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050219.983290:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 19 pid: 17185 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983300:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 19 pid: 17185 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983314:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba983570e00/0x3b8ec5973df5864c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58645 expref: 19 pid: 17185 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983325:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050219.983353:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3647:x1875954714711168:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.983360:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050219.983372:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050219.983378:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:3644:x1875954714711296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050219.983395:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050219.983399:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 17 pid: 17186 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983408:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 17 pid: 17186 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983418:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa86db0400/0x3b8ec5973df58588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58581 expref: 17 pid: 17186 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983430:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983438:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789050219.983451:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005424052s 00010000:00010000:1.0:1789050219.983455:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983462:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983468:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983475:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983480:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050219.983484:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983498:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983512:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983520:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050219.983549:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:3644:x1875954714711296:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.983554:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050219.983587:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714711168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050219.983602:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983610:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.983617:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae694600/0x3b8ec5973df58684 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.983638:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714711296:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1789050220.003584:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789050220.003655:0:17948:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789050220.003659:0:17948:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789050220.003881:0:17949:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1789050220.004382:0:17949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789050220.005378:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789050220.006994:0:17949:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789050220.007061:0:17949:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789050220.016483:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789050220.016561:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050220.016603:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050220.016667:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711424 00000100:00100000:3.0:1789050220.016674:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711424 00000100:00100000:3.0:1789050220.016729:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050220.016748:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.016840:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050220.016847:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050220.016886:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711424:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789050220.016915:0:17950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789050220.016965:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.016998:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050220.017020:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050220.017445:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711552 00000100:00100000:1.0:1789050220.017450:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711552 00000100:00100000:1.0:1789050220.017485:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050220.017493:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789050220.017598:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050220.017617:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050220.017751:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.017982:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17950:1875954714711680:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.018015:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050220.018036:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050220.018302:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711680 00000100:00100000:1.0:1789050220.018308:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711680 00000100:00100000:0.0:1789050220.018437:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050220.018446:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17950:x1875954714711680:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789050220.018502:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17950:x1875954714711680:12345-0@lo:900:lod0001_rec0000.0 Request processed in 58us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050220.018509:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789050220.018586:0:17950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8baaae794e00 x1875954714711680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789050236 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050220.018597:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17950:1875954714711680:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.018650:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789050220.018676:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050220.018698:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050220.018748:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711808 00000100:00100000:1.0:1789050220.018753:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711808 00000100:00100000:1.0:1789050220.018783:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050220.018789:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789050220.019004:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875954714711808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 146us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050220.019012:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050220.019107:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875954714711808:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789050220.019161:0:17950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789050220.021267:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789050220.021309:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789050220.021721:0:17924:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789050220.021728:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789050220.021769:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050220.022745:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789050220.022827:0:17950:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789050220.022833:0:17950:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1789050220.023984:0:17924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789050220.024696:0:17924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789050220.024740:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789050220.024902:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789050220.027382:0:17924:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1789050220.031695:0:17924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789050220.047398:0:17924:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789050220.047438:0:17924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaeaec1cab988 00100000:10000000:2.0:1789050220.047447:0:17924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789050220.048909:0:17924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789050220.048976:0:17924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789050220.048996:0:17924:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789050220.049013:0:17924:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789050220.050855:0:17924:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050220.051152:0:17924:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789050220.393848:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050220.843101:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050220.843218:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789050221.034529:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789050221.164534:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789050221.164542:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba9834d3800 from 8 10000000:01000000:1.0:1789050221.164547:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789050221.164594:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050221.164606:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050221.164616:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050221.164639:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714711936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050221.164705:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050221.164771:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789050221.165304:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714711936 00000100:00100000:2.0:1789050221.165312:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714711936 00000100:00100000:2.0:1789050221.165365:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789050221.165374:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17189:x1875954714711936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050221.165396:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050221.165410:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5868b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050221.165433:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050221.165443:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050221.165451:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695a00, rc 0) 00000100:00100000:2.0:1789050221.165502:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714711936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050221.165523:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789050221.165676:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714711936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050221.165691:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050221.165705:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050221.165752:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789050221.165780:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050221.165811:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa914a7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050221.166371:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712064 00000100:00100000:3.0:1789050221.166377:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712064 00000100:00100000:3.0:1789050221.166423:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050221.166431:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714712064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050221.166447:0:17187:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050221.166461:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050221.166464:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789050221.166550:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714712064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050221.166557:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050221.166592:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789050221.166634:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050221.166641:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166649:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050221.166667:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789050221.166669:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba983e8d000 from 8 10000000:01000000:3.0:1789050221.166672:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789050221.166691:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166698:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166707:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050221.166720:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050221.166743:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050221.166762:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050221.166774:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712192 00000100:00100000:3.0:1789050221.166777:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712192 00000100:00100000:3.0:1789050221.166797:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789050221.166803:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714712192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050221.166809:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050221.166817:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58699 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166832:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166841:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166858:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603800, rc 0) 00000100:00100000:3.0:1789050221.166886:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714712192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050221.166892:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789050221.166918:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050221.166927:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.166934:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050221.166988:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789050221.167012:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050221.167023:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050221.167033:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712320 00000100:00100000:3.0:1789050221.167036:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712320 00000100:00100000:3.0:1789050221.167057:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050221.167062:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714712320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050221.167071:0:17187:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050221.167080:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050221.167083:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789050221.167139:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714712320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050221.167146:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050221.167175:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714712320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789050221.167222:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050221.167228:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050221.167235:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050221.417625:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050221.867113:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789050222.057845:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789050222.442240:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050222.894113:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789050223.470166:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050223.918652:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000001:02000400:2.0:1789050224.484563:0:18193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789050224.489620:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050224.938600:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 0 seconds 00000100:00080000:2.0:1789050225.257219:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789050225.257227:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789050225.257231:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050225.257250:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8baaa7dc4000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050225.257255:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714712448:0@lo:400:kworker.0 00000100:00100000:2.0:1789050225.257279:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2c380 x1875954714712704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050225.257296:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050225.257301:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050225.257328:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050225.257389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714712576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050225.257420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050225.257503:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712448 00000100:00100000:3.0:1789050225.257511:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712448 00000100:00100000:3.0:1789050225.257563:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050225.257572:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3645:x1875954714712448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050225.257633:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3645:x1875954714712448:12345-0@lo:400:kworker.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.257640:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050225.257670:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712576 00000100:00100000:3.0:1789050225.257674:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712576 00000100:00100000:3.0:1789050225.257699:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050225.257706:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714712576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050225.257731:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789050225.257742:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714712448:0@lo:400:kworker.0 00000100:00100000:3.0:1789050225.257785:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714712576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.257790:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789050225.257819:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714712576:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789050225.258775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050225.258782:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050225.258824:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050225.258828:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050225.258832:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050225.258835:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050225.258848:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714712832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050225.258876:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714712704:0@lo:38:kworker.0 00000100:00100000:1.0:1789050225.258909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050225.258916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050225.258979:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712832 00000100:00100000:1.0:1789050225.258985:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712832 00000100:00100000:1.0:1789050225.259023:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050225.259031:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714712832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050225.259073:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714712832:12345-0@lo:400:kworker.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050225.259079:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050225.259115:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714712960:0@lo:400:kworker.0 00000100:00100000:1.0:1789050225.259158:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050225.259213:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712960 00000100:00100000:1.0:1789050225.259217:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712960 00000100:00100000:1.0:1789050225.259257:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050225.259264:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714712960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050225.259300:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714712960:12345-0@lo:400:kworker.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050225.259306:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789050225.259342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba983f2d500 x1875954714712960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050225.259353:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714712960:0@lo:400:kworker.0 00010000:00080000:1.0:1789050225.259378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba983f2f100 x1875954714712832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050225.259386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714712832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050225.259411:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714712704 00000100:00100000:2.0:1789050225.259422:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714712704 00000100:00100000:2.0:1789050225.259451:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050225.259456:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875954714712704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789050225.259478:0:17198:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1789050225.259510:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df586a7 00000004:00100000:2.0:1789050225.259522:0:17198:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789050225.259527:0:17198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1789050225.275253:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8baaae51c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050225.275356:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875954714712704:12345-0@lo:38:kworker.0 Request processed in 15897us (16440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050225.275367:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789050225.275460:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789050225.275469:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:3.0:1789050225.275476:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789050225.275479:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaa7dc4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789050225.275520:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004af60d23): req@ffff8ba981b03800 x1875954714705536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050225.275539:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714712704:0@lo:38:kworker.0 00000100:00100000:3.0:1789050225.275612:0:17235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050225.275635:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaac69b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050225.275650:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714705536 00000100:00100000:3.0:1789050225.275656:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714705536 00000100:00100000:0.0:1789050225.275758:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050225.275767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714713088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050225.275792:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050225.282681:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713088 00000100:00100000:3.0:1789050225.282698:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713088 00000100:00100000:3.0:1789050225.282748:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050225.282757:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17235:x1875954714705536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.282955:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17235:x1875954714705536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 179us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.282963:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050225.283100:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050225.283109:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714713088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050225.283133:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789050225.283186:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714713088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (7383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.283193:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050225.283234:0:17235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1875954714705536:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789050225.283272:0:17235:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789050225.283331:0:17235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1875954714713216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.283368:0:17235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050225.283396:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050225.283408:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713216 00000100:00100000:3.0:1789050225.283417:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713216 00000100:00100000:3.0:1789050225.283438:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050225.283443:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1875954714713216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.283533:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1875954714713216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.283541:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050225.283564:0:17235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1875954714713216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.283627:0:17235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1875954714713344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.283653:0:17235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050225.283668:0:17235:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050225.283680:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713344 00000100:00100000:3.0:1789050225.283683:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713344 00000100:00100000:3.0:1789050225.283703:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050225.283708:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1875954714713344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789050225.283765:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1875954714713344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050225.283771:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050225.283930:0:17235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae797800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1875954714713344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789050225.284045:0:17235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050225.284361:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714713088:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789050225.286538:0:17235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789050225.286753:0:17235:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:2.0:1789050225.286759:0:17235:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1789050225.385462:0:18245:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789050225.386414:0:18245:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789050225.514913:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789050226.352280:0:18295:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789050226.352712:0:18295:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789050226.541114:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789050227.464444:0:18343:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe489ba400 20000000:00000080:0.0:1789050227.464468:0:18343:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baa8341e400 uarg=0000000000000000 20000000:01000000:0.0:1789050227.464522:0:18343:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789050227.464530:0:18343:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789050227.464536:0:18343:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789050227.465365:0:18344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789050227.465600:0:18343:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789050227.471562:0:18343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789050227.471607:0:18343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471631:0:18343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471641:0:18343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471650:0:18343:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471713:0:18343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471756:0:18343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 17 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050227.471775:0:18343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1875954714713472:0@lo:104: 00000100:00100000:2.0:1789050227.471874:0:18343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050227.471983:0:18343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.471994:0:18343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050227.472003:0:18343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1875954714713600:0@lo:104: 00000100:00100000:0.0:1789050227.472024:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713472 00000100:00100000:2.0:1789050227.472034:0:18343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050227.472038:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713472 00000100:00100000:2.0:1789050227.472063:0:18343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98250e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050227.472093:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713600 00000100:00100000:0.0:1789050227.472098:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713600 00000100:00100000:0.0:1789050227.472117:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050227.472129:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:18343:x1875954714713472:12345-0@lo:104: 00010000:00010000:0.0:1789050227.472180:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.472253:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050227.472261:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:18343:x1875954714713472:12345-0@lo:104: Request processed in 133us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050227.472271:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050227.472295:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050227.472303:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:18343:x1875954714713600:12345-0@lo:104: 00010000:00010000:0.0:1789050227.472312:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.472354:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789050227.472360:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:18343:x1875954714713600:12345-0@lo:104: Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050227.472367:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789050227.472389:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050227.472390:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050227.472397:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.472407:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:0.0:1789050227.472412:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.472424:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050227.472433:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050227.472446:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789050227.472774:0:18343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1875954714713472:0@lo:104: 00000100:00100000:2.0:1789050227.472784:0:18343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18343:1875954714713600:0@lo:104: 00010000:00010000:2.0:1789050227.472807:0:18343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050227.472837:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050227.472840:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050227.472842:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050227.472873:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473021:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473030:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050227.473049:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050227.473055:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050227.473064:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473072:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473092:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603000/0x3b8ec5973df58653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df5865a expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050227.473095:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050227.473110:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789050227.473114:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714713728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050227.473117:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050227.473121:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050227.473126:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050227.473145:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050227.473153:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789050227.473177:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050227.473206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714713856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050227.473240:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050227.473294:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713728 00000100:00100000:0.0:1789050227.473301:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713728 00010000:00010000:0.0:1789050227.473322:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 18 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050227.473348:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713856 00000100:00100000:0.0:1789050227.473351:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713856 00010000:00010000:0.0:1789050227.473363:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 19 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050227.473365:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050227.473380:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8ba983570600/0x3b8ec5973df58550 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58557 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050227.473384:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050227.473394:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:3646:x1875954714713728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050227.473401:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050227.473404:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050227.473406:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050227.473409:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050227.473416:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 19 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473438:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 19 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473472:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df5865a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58653 expref: 19 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473485:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050227.473534:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3646:x1875954714713728:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050227.473541:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050227.473556:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050227.473562:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:3647:x1875954714713856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050227.473584:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050227.473589:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473599:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050227.473604:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714713728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050227.473612:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa86db1400/0x3b8ec5973df58557 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58550 expref: 17 pid: 17186 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473624:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473633:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473983:0:17178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473994:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.473999:0:17178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.474003:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.474007:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050227.474010:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.474015:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.474030:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050227.474037:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050227.474065:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:3647:x1875954714713856:12345-0@lo:103:ldlm_bl.0 Request processed in 504us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050227.474070:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789050227.474087:0:18343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.474098:0:18343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050227.474105:0:18343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae694600/0x3b8ec5973df586ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050227.474640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714713856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050227.561128:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050228.592407:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789050229.161992:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050229.162004:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba9834d3800 from 13 10000000:01000000:1.0:1789050229.162012:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050229.162084:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050229.162098:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050229.162111:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050229.162172:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714713984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050229.162268:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050229.162326:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789050229.162499:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714713984 00000100:00100000:2.0:1789050229.162511:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714713984 00000100:00100000:2.0:1789050229.162585:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789050229.162597:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+16:17189:x1875954714713984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050229.162614:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050229.162630:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df586b5 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.162659:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.162672:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.162682:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694800, rc 0) 00000100:00100000:2.0:1789050229.162742:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714713984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050229.162750:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789050229.162849:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714713984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050229.162867:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050229.162889:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050229.162992:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050229.163020:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050229.163056:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050229.163180:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714112 00000100:00100000:3.0:1789050229.163195:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714112 00000100:00100000:3.0:1789050229.163224:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050229.163232:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714714112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050229.163386:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714714112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050229.163393:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050229.163520:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050229.163553:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050229.163597:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050229.163620:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789050229.163677:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714240 00000100:00100000:2.0:1789050229.163682:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714240 00000100:00100000:2.0:1789050229.163716:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789050229.163724:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714714240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050229.163825:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714714240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050229.163833:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050229.164015:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789050229.164984:0:18406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789050229.167112:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789050229.167169:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050229.167185:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050229.167201:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050229.167215:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789050229.167219:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba983e8d000 from 13 10000000:01000000:3.0:1789050229.167222:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050229.167276:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050229.167285:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050229.167298:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050229.167330:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050229.167424:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050229.167545:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050229.176960:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714368 00000100:00100000:2.0:1789050229.176983:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714368 00000100:00100000:2.0:1789050229.177083:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789050229.177095:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+17:17189:x1875954714714368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050229.177117:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050229.177141:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df586c3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.177191:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.177205:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050229.177216:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695c00, rc 0) 00000100:00100000:2.0:1789050229.177325:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714714368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (9900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050229.177332:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789050229.177543:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050229.177574:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050229.177586:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050229.177687:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050229.177731:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050229.177778:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050229.177837:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714496 00000100:00100000:0.0:1789050229.177843:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714496 00000100:00100000:0.0:1789050229.177881:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789050229.177889:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714714496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050229.178063:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714714496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.178082:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789050229.178189:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050229.178238:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050229.178280:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050229.178306:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050229.178356:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714624 00000100:00100000:0.0:1789050229.178361:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714624 00000100:00100000:0.0:1789050229.178390:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789050229.178397:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714714624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050229.178489:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:17189:x1875954714714624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.178496:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789050229.178571:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714714624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789050229.179446:0:18407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789050229.179618:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789050229.179642:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050229.179654:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050229.179665:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050229.353878:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050219/real 1789050219] req@ffff8baaae796d80 x1875954714708864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.353908:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8baaae796d80 x1875954714708864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.353919:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050219/real 1789050219] req@ffff8ba983f2ed80 x1875954714708736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.360602:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba983f2ed80 x1875954714708736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789050229.360629:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050229.360645:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050229.360664:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708864:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789050229.360670:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab9998000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050229.360675:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050229.360678:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714708736:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789050229.360975:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.360980:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050229.360983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.360986:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050229.361014:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.361017:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789050229.361020:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baab9998000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050229.361025:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1789050229.361030:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050229.361046:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8baab9998000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789050229.361067:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba981b03b80 x1875954714715136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050229.361081:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.361084:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789050229.361086:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050229.361089:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1789050229.361091:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050229.361095:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789050229.361107:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba981b01c00 x1875954714715264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050229.361140:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714715008:0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361211:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050229.361244:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050229.361250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714715392:0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050229.361311:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715008 00000100:00100000:0.0:1789050229.361319:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715008 00000100:00100000:0.0:1789050229.361361:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789050229.361370:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714715008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361417:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714715008:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.361424:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789050229.361449:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715392 00000100:00100000:0.0:1789050229.361453:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715392 00000100:00100000:0.0:1789050229.361478:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050229.361491:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714715392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361521:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714715392:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.361527:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050229.361534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714714752:0@lo:400:kworker.0 00010000:00080000:0.0:1789050229.361563:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba981b02300 x1875954714715392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050229.361574:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714715392:0@lo:400:kworker.0 00000100:00100000:1.0:1789050229.361684:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714714880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050229.361697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050229.361713:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050229.361751:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714880 00000100:00100000:3.0:1789050229.361755:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714880 00000100:00100000:3.0:1789050229.361780:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050229.361787:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714714880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361823:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714715008:0@lo:400:kworker.0 00000100:00100000:3.0:1789050229.361826:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714714880:12345-0@lo:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050229.361832:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050229.361848:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714714752 00000100:00100000:0.0:1789050229.361852:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714714752 00000100:00100000:0.0:1789050229.361877:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050229.361884:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714714752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361920:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875954714714752:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.361925:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050229.361977:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714714752:0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.361996:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714715136:0@lo:8:kworker.0 00000400:00000100:0.0:1789050229.362018:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714715136 offset 0 length 520: 4 00000100:00100000:0.0:1789050229.362038:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714715264:0@lo:8:kworker.0 00000400:00000100:0.0:1789050229.362055:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714715264 offset 0 length 520: 4 00010000:00080000:1.0:1789050229.362129:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba981b02a00 x1875954714714880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050229.362140:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714714880:0@lo:400:kworker.0 00010000:00010000:0.0:1789050229.609188:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050230.070718:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050230.378167:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050230.378190:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714715520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050230.378249:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050230.378362:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714715648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050230.378390:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050230.378451:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715520 00000100:00100000:1.0:1789050230.378459:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715520 00000100:00100000:1.0:1789050230.378503:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715648 00000100:00100000:1.0:1789050230.378506:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715648 00000100:00100000:1.0:1789050230.378523:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050230.378532:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714715520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050230.378566:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789050230.378637:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714715520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050230.378644:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050230.378661:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050230.378667:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714715648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050230.378684:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789050230.378710:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875954714715648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050230.378716:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050230.378754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714715648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050230.378766:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714715520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789050230.634980:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789050230.896536:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789050231.657088:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050232.297498:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789050232.683136:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050233.451100:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050218/real 1789050218] req@ffff8ba983f2d180 x1875954714706560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050233 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050233.451146:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba983f2d180 x1875954714706560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050233 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050233.451156:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050218/real 1789050218] req@ffff8ba983f2d880 x1875954714706688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050233 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050233.451166:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba983f2d880 x1875954714706688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050233 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050233.451186:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050233.451199:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050233.451203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706560:0@lo:8:kworker.0 00000100:00080000:0.0:1789050233.451208:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050233.451212:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050233.451215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714706688:0@lo:8:kworker.0 00000100:00100000:3.0:1789050233.451395:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714715776:0@lo:400:kworker.0 00000100:00100000:3.0:1789050233.451457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050233.451563:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715776 00000100:00100000:0.0:1789050233.451578:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715776 00000100:00100000:0.0:1789050233.451623:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789050233.451630:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3646:x1875954714715776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789050233.460200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050233.460211:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789050233.460396:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050233.460404:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789050233.460409:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789050233.460419:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8baab771c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050233.460455:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a3800 x1875954714716032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050233.460483:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050233.460487:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789050233.460488:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050233.460491:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789050233.460494:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789050233.460499:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8baab0ea1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050233.460510:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a2d80 x1875954714716160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050233.460544:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050233.460548:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050233.460550:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050233.460553:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050233.460593:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714716288:0@lo:400:kworker.0 00000100:00100000:1.0:1789050233.460657:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050233.460695:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050233.460701:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714716416:0@lo:400:kworker.0 00000100:00100000:1.0:1789050233.460724:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050233.460757:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716288 00000100:00100000:1.0:1789050233.460771:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716288 00000100:00100000:1.0:1789050233.460816:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050233.460824:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714716288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050233.460870:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714716288:12345-0@lo:400:kworker.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050233.460876:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050233.460898:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716416 00000100:00100000:1.0:1789050233.460901:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716416 00000100:00100000:1.0:1789050233.460924:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789050233.460930:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714716416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050233.460986:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714716416:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050233.460991:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789050233.461028:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714716416:0@lo:400:kworker.0 00010000:00080000:1.0:1789050233.461039:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baab78a2a00 x1875954714716288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050233.461048:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714716288:0@lo:400:kworker.0 00000100:00100000:0.0:1789050233.461524:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:3646:x1875954714715776:12345-0@lo:400:kworker.0 Request processed in 9890us (10063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050233.461534:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789050233.461565:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714716032:0@lo:8:kworker.0 00000400:00000100:0.0:1789050233.461593:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714716032 offset 0 length 520: 4 00000100:00100000:0.0:1789050233.461621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714716160:0@lo:8:kworker.0 00000400:00000100:0.0:1789050233.461655:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954714716160 offset 0 length 520: 4 00000100:00100000:0.0:1789050233.461684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714715904:0@lo:400:kworker.0 00000100:00100000:0.0:1789050233.461713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050233.461733:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050233.461739:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714716544:0@lo:400:kworker.0 00000100:00100000:0.0:1789050233.461765:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050233.461800:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714715904 00000100:00100000:0.0:1789050233.461805:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714715904 00000100:00100000:0.0:1789050233.461836:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050233.461843:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714715904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050233.461880:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714715904:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050233.461885:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050233.461911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714715904:0@lo:400:kworker.0 00000100:00100000:3.0:1789050233.462392:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714715776:0@lo:400:kworker.0 00000100:00100000:3.0:1789050233.462428:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716544 00000100:00100000:3.0:1789050233.462432:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716544 00000100:00100000:3.0:1789050233.462470:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050233.462479:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714716544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050233.462540:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714716544:12345-0@lo:400:kworker.0 Request processed in 63us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050233.462547:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789050233.462564:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baab78a0380 x1875954714716544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050233.462576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714716544:0@lo:400:kworker.0 00010000:00010000:1.0:1789050233.706859:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050234.751479:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789050235.189544:0:18694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789050235.189548:0:18694:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789050235.189550:0:18694:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789050235.189661:0:18694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8baa90bd4800 00000020:01000004:0.0:1789050235.189678:0:18694:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789050235.189691:0:18694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789050235.189705:0:18694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8baa877219c0) 00000020:00000080:0.0:1789050235.189723:0:18694:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789050235.246389:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789050235.261452:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789050235.262581:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789050235.262795:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789050235.263514:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789050235.263713:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789050235.264187:0:18694:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789050235.266342:0:18694:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789050235.266570:0:18694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789050235.266584:0:18694:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789050235.266596:0:18694:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3b8ec5973df586d8 00000020:01000004:1.0:1789050235.266603:0:18694:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789050235.266628:0:18694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789050235.266631:0:18694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789050235.266638:0:18694:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789050235.266642:0:18694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789050235.266654:0:18694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8baab4e399c0) 00000020:00000080:1.0:1789050235.266666:0:18694:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789050235.268541:0:18694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050235.268699:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050235.268705:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789050235.270124:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789050235.270135:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789050235.270565:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789050235.270571:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789050235.283675:0:18694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050235.284819:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789050235.284826:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789050235.285884:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789050235.285893:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789050235.318837:0:18694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050235.319494:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050235.319501:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789050235.323509:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789050235.323526:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789050235.329230:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789050235.333330:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789050235.357591:0:18694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050235.358410:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789050235.358419:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789050235.359649:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789050235.359662:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789050235.492652:0:18694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050235.493377:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789050235.493385:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789050235.495137:0:18694:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789050235.495149:0:18694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789050235.496114:0:18694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789050235.496144:0:18694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789050235.496150:0:18694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00100000:0.0:1789050235.502771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714716672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050235.502881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050235.502972:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716672 00000100:00100000:0.0:1789050235.502981:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716672 00000100:00100000:0.0:1789050235.503029:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050235.503038:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714716672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050235.503070:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050235.503129:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714716672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.503136:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050235.503182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714716672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050235.509621:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714716800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050235.509700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.510168:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716800 00000100:00100000:3.0:1789050235.510178:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716800 00000100:00100000:3.0:1789050235.510227:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789050235.510242:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714716800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050235.510296:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050235.515600:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714716800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5359us (5893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050235.515614:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050235.520619:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714716800:0@lo:41:osp-pre-0-1.0 00000040:01000000:0.0:1789050235.523129:0:18694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789050235.523169:0:18694:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789050235.523174:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789050235.523176:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050235.523177:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050235.523179:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050235.523180:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050235.523181:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050235.523183:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050235.523185:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050235.523186:0:18694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050235.523190:0:18694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789050235.523192:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789050235.523193:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050235.523194:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050235.523196:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050235.523197:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050235.523198:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050235.523199:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050235.523200:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050235.523201:0:18694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050235.523230:0:18694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789050235.523257:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714716928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789050235.523324:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050235.523408:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85ea6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.524212:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714716928 00000100:00100000:2.0:1789050235.524221:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714716928 00000100:00100000:2.0:1789050235.524364:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050235.524374:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:18694:x1875954714716928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789050235.524403:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789050235.524406:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789050235.524410:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789050235.524788:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:18694:x1875954714716928:12345-0@lo:253:mount.lustre.0 Request processed in 414us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.524796:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789050235.525193:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714716928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050235.525208:0:18694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789050235.525211:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050235.525212:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050235.525213:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050235.525215:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050235.525216:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050235.525217:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050235.525219:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050235.525220:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050235.525221:0:18694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789050235.525264:0:18694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8baa90bd4800 from lustre-OST0000 10000000:01000000:1.0:1789050235.525294:0:18694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789050235.525297:0:18694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789050235.525306:0:18694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857acd40 local copy 00010000:00010000:1.0:1789050235.525316:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.525429:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050235.525467:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.525535:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.529768:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717056 00000100:00100000:2.0:1789050235.529784:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717056 00000100:00100000:2.0:1789050235.530047:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050235.530058:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:18694:x1875954714717056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050235.530219:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:18694:x1875954714717056:12345-0@lo:501:mount.lustre.0 Request processed in 163us (4750us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050235.530226:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789050235.530505:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789050235.530527:0:18694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789050235.530553:0:18694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789050235.530562:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.530574:0:18694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050235.530608:0:18694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baa90bd4800 10000000:01000000:1.0:1789050235.530613:0:18694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789050235.530619:0:18694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789050235.530621:0:18694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050235.530626:0:18694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789050235.530628:0:18694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789050235.530656:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.531016:0:18694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.531042:0:18694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.531062:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050235.531102:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.531142:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.531397:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717184 00000100:00100000:2.0:1789050235.531404:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717184 00000100:00100000:2.0:1789050235.531446:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789050235.531455:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+18:18694:x1875954714717184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050235.531474:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050235.531487:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695400/0x3b8ec5973df586ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df586e6 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.531510:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695400/0x3b8ec5973df586ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df586e6 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.531522:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695400/0x3b8ec5973df586ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df586e6 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.531531:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695400, rc 0) 00000100:00100000:2.0:1789050235.531580:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717184:12345-0@lo:101:mount.lustre.0 Request processed in 126us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.531586:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050235.532071:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050235.532087:0:18694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ed expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.532096:0:18694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df586ed expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050235.536218:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789050235.539203:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050235.552797:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789050235.553130:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789050235.553157:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789050235.553175:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789050235.553191:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789050235.553207:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789050235.554324:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789050235.554342:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789050235.554459:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050235.554525:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050235.554627:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.563058:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717312 00000100:00100000:0.0:1789050235.563072:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717312 00000100:00100000:0.0:1789050235.572014:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789050235.572034:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050235.572309:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717312:12345-0@lo:501:mount.lustre.0 Request processed in 284us (17783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.572317:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789050235.572442:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050235.572492:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050235.572547:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050235.572592:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.573072:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717440 00000100:00100000:0.0:1789050235.573081:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717440 00000100:00100000:0.0:1789050235.573132:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789050235.573140:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050235.575089:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717440:12345-0@lo:503:mount.lustre.0 Request processed in 1940us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.575101:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050235.575279:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789050235.576135:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789050235.576222:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050235.576288:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050235.576326:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.578287:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717568 00000100:00100000:0.0:1789050235.578301:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717568 00000100:00100000:0.0:1789050235.578367:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789050235.578377:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050235.579769:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717568:12345-0@lo:502:mount.lustre.0 Request processed in 1387us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.579780:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050235.580373:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050235.580650:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789050235.580762:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789050235.580775:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789050235.580787:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789050235.580798:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789050235.580807:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789050235.580993:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789050235.581004:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789050235.581014:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789050235.581041:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789050235.581053:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789050235.581062:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789050235.581095:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050235.581157:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050235.581416:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.581460:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717696 00000100:00100000:0.0:1789050235.581467:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717696 00000100:00100000:0.0:1789050235.581574:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789050235.581583:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050235.581688:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717696:12345-0@lo:502:mount.lustre.0 Request processed in 107us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.581695:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789050235.581755:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050235.581793:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789050235.581801:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789050235.582346:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050235.582354:0:18711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789050235.582361:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.582368:0:18711:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789050235.582375:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050235.582388:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8baabd17cd40) 00000020:00000080:2.0:1789050235.582410:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789050235.582415:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789050235.582489:0:18711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa90bd4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789050235.582497:0:18711:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789050235.582504:0:18711:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3b8ec5973df586fb 00010000:00010000:2.0:1789050235.587113:0:18711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789050235.587755:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789050235.591147:0:18711:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789050235.592439:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789050235.592450:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050235.592455:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592457:0:18711:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789050235.592461:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050235.592463:0:18711:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789050235.592465:0:18711:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050235.592466:0:18711:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050235.592468:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050235.592470:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592471:0:18711:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050235.592474:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050235.592477:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592478:0:18711:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789050235.592481:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789050235.592483:0:18711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789050235.592484:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050235.592486:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592487:0:18711:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789050235.592490:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050235.592492:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592493:0:18711:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789050235.592496:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789050235.592528:0:18711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050235.592531:0:18711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050235.592532:0:18711:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789050235.592535:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789050235.597391:0:18694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789050235.597437:0:18694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789050235.597458:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ed expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.597471:0:18694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983570000/0x3b8ec5973df586e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df586ed expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050235.597496:0:18694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baa90bd4800 from 1 10000000:01000000:3.0:1789050235.597499:0:18694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050235.597537:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.597545:0:18694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.597557:0:18694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050235.597586:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050235.597655:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.597697:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.599334:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717824 00000100:00100000:2.0:1789050235.599343:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717824 00000100:00100000:2.0:1789050235.599390:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789050235.599400:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:18694:x1875954714717824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050235.599419:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050235.599434:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58702 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.599461:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.599471:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.599622:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695e00, rc 0) 00000100:00100000:2.0:1789050235.599691:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714717824:12345-0@lo:101:mount.lustre.0 Request processed in 292us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.599697:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789050235.599724:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050235.599744:0:18694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.599756:0:18694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050235.601031:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789050235.601441:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050235.601609:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789050235.601638:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789050235.601657:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789050235.601663:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789050235.601729:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050235.601791:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.602036:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.602151:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714717952 00000100:00100000:0.0:1789050235.602556:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714717952 00000100:00100000:0.0:1789050235.602617:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789050235.602627:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714717952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050235.603046:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714717952:12345-0@lo:501:mount.lustre.0 Request processed in 420us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.603055:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789050235.603271:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714717952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050235.603323:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050235.603370:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.603396:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.603613:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718080 00000100:00100000:2.0:1789050235.603620:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718080 00000100:00100000:2.0:1789050235.603675:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789050235.603685:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050235.603782:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718080:12345-0@lo:503:mount.lustre.0 Request processed in 98us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.603790:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789050235.603805:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050235.604232:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050235.604312:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050235.604353:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.604386:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.604860:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718208 00000100:00100000:0.0:1789050235.604867:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718208 00000100:00100000:0.0:1789050235.604971:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789050235.604980:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050235.605080:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718208:12345-0@lo:502:mount.lustre.0 Request processed in 102us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.605087:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789050235.605197:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050235.605412:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789050235.605453:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789050235.605471:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789050235.605484:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789050235.605497:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789050235.605511:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789050235.605524:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789050235.605537:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789050235.605550:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789050235.605564:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789050235.605577:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789050235.605603:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050235.605642:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.605672:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050235.605684:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718336 00000100:00100000:0.0:1789050235.605740:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718336 00000100:00100000:0.0:1789050235.605804:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789050235.605811:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050235.605884:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718336:12345-0@lo:502:mount.lustre.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.605891:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789050235.606732:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050235.606793:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789050235.606804:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789050235.608704:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050235.608717:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608720:0:18715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789050235.608727:0:18715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baa90bd4800 00000020:00000080:1.0:1789050235.608730:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050235.608738:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050235.608741:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608742:0:18715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789050235.608745:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050235.608747:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608748:0:18715:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789050235.608751:0:18715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baa90bd4800 00000020:00000080:1.0:1789050235.608753:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050235.608808:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050235.608813:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608814:0:18715:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789050235.608817:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050235.608820:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608821:0:18715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789050235.608825:0:18715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baa90bd4800 00000020:00000080:1.0:1789050235.608827:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050235.608843:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050235.608846:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608847:0:18715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789050235.608849:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050235.608861:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608863:0:18715:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789050235.608867:0:18715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baa90bd4800 00000020:00000080:1.0:1789050235.608868:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050235.608896:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050235.608900:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050235.608901:0:18715:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789050235.608904:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789050235.608989:0:18694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789050235.609021:0:18694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050235.609050:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.609062:0:18694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050235.609125:0:18694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789050235.609128:0:18694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baa90bd4800 10000000:01000000:2.0:1789050235.609131:0:18694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baa90bd4800 10000000:01000000:2.0:1789050235.609135:0:18694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789050235.609140:0:18694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baa90bd4800 from 1 10000000:01000000:2.0:1789050235.609143:0:18694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789050235.609175:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.609182:0:18694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050235.609192:0:18694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050235.609222:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050235.609277:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050235.609306:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa85157900 going to sleep for 11 seconds 00000100:00100000:1.0:1789050235.609931:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718464 00000100:00100000:1.0:1789050235.609976:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718464 00000100:00100000:1.0:1789050235.610027:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789050235.610044:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:18694:x1875954714718464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050235.610065:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050235.610079:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba983571e00/0x3b8ec5973df58717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58710 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.610114:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba983571e00/0x3b8ec5973df58717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58710 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.610126:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba983571e00/0x3b8ec5973df58717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58710 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.610135:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571e00, rc 0) 00000100:00100000:1.0:1789050235.610195:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718464:12345-0@lo:101:mount.lustre.0 Request processed in 160us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050235.610202:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789050235.610476:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050235.610494:0:18694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58717 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.610503:0:18694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58717 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050235.625244:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789050235.625590:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050235.628455:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789050235.628510:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789050235.628523:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789050235.628535:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789050235.628546:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789050235.628566:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789050235.628578:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789050235.628589:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789050235.628600:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789050235.628611:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789050235.628621:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789050235.628633:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789050235.628644:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789050235.628656:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789050235.628666:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789050235.628677:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789050235.628688:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789050235.628716:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789050235.628726:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789050235.628738:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789050235.628748:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789050235.628763:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789050235.628790:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789050235.628803:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789050235.628814:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789050235.628825:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789050235.628836:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789050235.628847:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789050235.628858:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789050235.628868:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789050235.628880:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789050235.628890:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789050235.628901:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789050235.628912:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789050235.628924:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789050235.628968:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789050235.628986:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789050235.629022:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789050235.629034:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789050235.629165:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050235.629235:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.629275:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297300 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.630152:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718592 00000100:00100000:2.0:1789050235.630164:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718592 00000100:00100000:2.0:1789050235.630215:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789050235.630224:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050235.630387:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718592:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.630394:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789050235.631149:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050235.631197:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050235.631244:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.631755:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.631881:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718720 00000100:00100000:2.0:1789050235.631887:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718720 00000100:00100000:2.0:1789050235.631929:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789050235.631955:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050235.632115:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718720:12345-0@lo:503:mount.lustre.0 Request processed in 168us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.632123:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789050235.633420:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae796d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050235.633886:0:18694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050235.633987:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050235.634055:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.634090:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.634568:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718848 00000100:00100000:2.0:1789050235.634577:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718848 00000100:00100000:2.0:1789050235.634625:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789050235.634634:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050235.634750:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718848:12345-0@lo:502:mount.lustre.0 Request processed in 108us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.634757:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789050235.634923:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050235.635479:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789050235.635510:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789050235.635522:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789050235.635534:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789050235.635545:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789050235.635570:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789050235.635582:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789050235.635594:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789050235.635605:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789050235.635616:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789050235.635627:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789050235.635638:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789050235.635649:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789050235.635660:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789050235.635671:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789050235.635681:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789050235.635693:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789050235.635704:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789050235.635714:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789050235.635734:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789050235.635745:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789050235.635767:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789050235.635779:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789050235.635791:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789050235.635806:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789050235.635818:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789050235.635829:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789050235.635841:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789050235.635852:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789050235.635863:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789050235.635874:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789050235.635885:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789050235.635896:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789050235.635907:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789050235.635918:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789050235.635928:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789050235.635969:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789050235.635994:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789050235.636326:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789050235.636345:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789050235.636357:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789050235.636368:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789050235.636379:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789050235.636391:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789050235.636402:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789050235.636413:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789050235.636424:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789050235.636436:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789050235.636481:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050235.636542:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.636603:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050235.636647:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714718976 00000100:00100000:3.0:1789050235.636655:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714718976 00000100:00100000:3.0:1789050235.636724:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789050235.636733:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050235.636837:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714718976:12345-0@lo:502:mount.lustre.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050235.636844:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789050235.636918:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714718976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050235.637086:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789050235.637121:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789050235.637142:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714719104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050235.637173:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.637468:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050235.637497:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719104 00000100:00100000:2.0:1789050235.637501:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719104 00000100:00100000:2.0:1789050235.637524:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789050235.637531:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714719104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050235.637607:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714719104:12345-0@lo:502:mount.lustre.0 Request processed in 76us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.637614:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789050235.637676:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714719104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050235.637711:0:18694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789050235.637717:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789050235.639375:0:18720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789050235.639391:0:18720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8baabd178000) 00000020:00000080:2.0:1789050235.639419:0:18720:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789050235.639491:0:18720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa90bd4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789050235.639495:0:18720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baa90bd4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789050235.639497:0:18720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baa90bd4800 3 00010000:00080000:2.0:1789050235.639525:0:18720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baa985b8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050235.643684:0:18720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789050235.643887:0:18720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789050235.643959:0:18720:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789050235.643972:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3b8ec5973df58725 00000100:00080000:2.0:1789050235.643981:0:18720:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050235.643992:0:18720:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8baa985b8000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050235.644025:0:18720:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2f100 x1875954714719232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050235.644047:0:18720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789050235.644265:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.644270:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.644273:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.644276:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.644304:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.644307:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.644310:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.644313:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050235.644345:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050235.644358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714719360:0@lo:400:kworker.0 00000100:00100000:1.0:1789050235.644416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.644458:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719360 00000100:00100000:1.0:1789050235.644464:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719360 00000100:00100000:1.0:1789050235.644497:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050235.644506:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714719360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050235.644557:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714719360:12345-0@lo:400:kworker.0 Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050235.644564:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789050235.644597:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baab78a3b80 x1875954714719360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050235.644610:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714719360:0@lo:400:kworker.0 00000100:00100000:0.0:1789050235.646489:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714719488:0@lo:400:kworker.0 00000100:00100000:0.0:1789050235.646557:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050235.646635:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719488 00000100:00100000:0.0:1789050235.646642:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719488 00000100:00100000:0.0:1789050235.646691:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050235.646700:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714719488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050235.646755:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714719488:12345-0@lo:400:kworker.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050235.646763:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789050235.646802:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8baab78a2680 x1875954714719488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050235.646817:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714719488:0@lo:400:kworker.0 00000100:00100000:3.0:1789050235.648000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714719232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050235.648044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050235.648094:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719232 00000100:00100000:3.0:1789050235.648118:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719232 00000100:00100000:3.0:1789050235.648150:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050235.648155:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714719232:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789050235.648179:0:17193:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:3.0:1789050235.648222:0:17193:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3b8ec5973df5872c 00000004:00100000:3.0:1789050235.648235:0:17193:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789050235.648262:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8ba983164000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050235.648302:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875954714719232:12345-0@lo:38:llog_process_th.0 Request processed in 145us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050235.648309:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789050235.648354:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba983f2f100 x1875954714719232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050235.648363:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789050235.648370:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789050235.648377:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789050235.648381:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789050235.648383:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa985b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789050235.648388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875954714719232:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789050235.655073:0:18720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789050235.655115:0:18720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ba983e83380) 00000020:00000080:2.0:1789050235.655141:0:18720:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789050235.655225:0:18720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa90bd4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789050235.655230:0:18720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baa90bd4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789050235.655346:0:18720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baa90bd4800 3 00010000:00080000:2.0:1789050235.655378:0:18720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baaae51e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789050235.657726:0:18720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789050235.658034:0:18720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789050235.658076:0:18720:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789050235.658089:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3b8ec5973df5873a 00000100:00080000:2.0:1789050235.658099:0:18720:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050235.658119:0:18720:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8baaae51e000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050235.658154:0:18720:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2d500 x1875954714719616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050235.658201:0:18720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789050235.658760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.658766:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.658769:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.658771:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.658775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.658778:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050235.658781:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050235.658783:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050235.660714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714719616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050235.660772:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789050235.661401:0:18720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789050235.661578:0:18694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789050235.661608:0:18694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789050235.661631:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58717 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.661643:0:18694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694200/0x3b8ec5973df58710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58717 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789050235.661687:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789050235.661690:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050235.661694:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050235.661695:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050235.661697:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050235.661699:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050235.661700:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050235.661702:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050235.661703:0:18694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050235.661706:0:18694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789050235.661708:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789050235.661710:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050235.661711:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050235.661712:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050235.661713:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050235.661714:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050235.661715:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050235.661716:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050235.661717:0:18694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050235.661738:0:18694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789050235.661752:0:18694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714719744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789050235.661792:0:18694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.661821:0:18694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050235.661975:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719744 00000100:00100000:3.0:1789050235.661983:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719744 00000100:00100000:3.0:1789050235.662030:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789050235.662042:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714719744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789050235.662067:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789050235.662080:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789050235.663225:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719616 00000100:00100000:1.0:1789050235.663234:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719616 00000100:00100000:1.0:1789050235.663271:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050235.663278:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875954714719616:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789050235.663302:0:17193:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:1.0:1789050235.663333:0:17193:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3b8ec5973df58741 00000004:00100000:1.0:1789050235.663356:0:17193:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789050235.663387:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8baa84b13000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050235.663494:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875954714719616:12345-0@lo:38:llog_process_th.0 Request processed in 215us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050235.663502:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789050235.668658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba983f2d500 x1875954714719616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050235.668673:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050235.668684:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789050235.668693:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789050235.668699:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789050235.668702:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baaae51e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789050235.668709:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875954714719616:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789050235.671422:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789050235.671532:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789050235.671636:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789050235.671646:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789050235.671669:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.671689:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.671698:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.671705:0:17208:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.671754:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.671769:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 21 pid: 17187 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.671784:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714719872:0@lo:104: 00000100:00100000:3.0:1789050235.672071:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:18694:x1875954714719744:12345-0@lo:253:mount.lustre.0 Request processed in 10030us (10276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050235.672081:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789050235.672169:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050235.672222:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050235.672311:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714719872 00000100:00100000:3.0:1789050235.672320:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714719872 00000100:00100000:3.0:1789050235.672358:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050235.672366:0:18694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:18694:1875954714719744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789050235.672368:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714719872:12345-0@lo:104: 10000000:01000000:2.0:1789050235.672384:0:18694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:3.0:1789050235.672385:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789050235.672388:0:18694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050235.672391:0:18694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789050235.672394:0:18694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050235.672398:0:18694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050235.672400:0:18694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050235.672401:0:18694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050235.672402:0:18694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050235.672404:0:18694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050235.672406:0:18694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789050235.672420:0:18694:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789050235.672450:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789050235.672457:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714719872:12345-0@lo:104: Request processed in 92us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050235.672464:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789050235.672549:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 20 pid: 17186 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.672564:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714720000:0@lo:104: 00000100:00100000:1.0:1789050235.672599:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050235.672657:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050235.672670:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714719872:0@lo:104: 00000100:00100000:3.0:1789050235.672718:0:17176:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789050235.672730:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720000 00000100:00100000:3.0:1789050235.672734:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720000 00000100:00100000:3.0:1789050235.672760:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050235.672768:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714720000:12345-0@lo:104: 00010000:00010000:3.0:1789050235.672776:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050235.672805:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050235.672813:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050235.672817:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789050235.672821:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602e00 already unused, calling callback (ffffffffc1287c20) 00000100:00100000:3.0:1789050235.672823:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714720000:12345-0@lo:104: Request processed in 56us (223us total) trans 0 rc 0/0 10000000:00010000:0.0:1789050235.672826:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050235.672829:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789050235.672835:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050235.672844:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050235.672860:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789050235.672891:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050235.672898:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789050235.672972:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714720128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050235.672973:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050235.672978:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.672985:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:1.0:1789050235.672988:0:18345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.672995:0:18345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050235.673001:0:18345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050235.673007:0:18345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789050235.673016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050235.673025:0:18345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673031:0:18345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050235.673048:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673055:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8ba983571600/0x3b8ec5973df5868b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58692 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673068:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050235.673071:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050235.673073:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050235.673086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714720256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050235.673130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050235.673162:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050235.673170:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602e00/0x3b8ec5973df58699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586a0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050235.673183:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050235.673184:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720128 00010000:00010000:0.0:1789050235.673185:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050235.673187:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050235.673188:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720128 00000100:00100000:0.0:1789050235.673203:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720256 00010000:00010000:1.0:1789050235.673207:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 21 pid: 17187 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050235.673207:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720256 00010000:00010000:0.0:1789050235.673220:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 22 pid: 17186 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.673229:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050235.673235:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3647:x1875954714720128:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050235.673244:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789050235.673246:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050235.673250:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 22 pid: 17187 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050235.673250:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3644:x1875954714720256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050235.673256:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050235.673259:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 22 pid: 17186 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673260:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 22 pid: 17187 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050235.673269:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 22 pid: 17186 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673280:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603800/0x3b8ec5973df586a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58699 expref: 22 pid: 17187 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673549:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.673558:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789050235.675007:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005424052s 00010000:00010000:1.0:1789050235.675019:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675028:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675035:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675054:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675060:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050235.675064:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675073:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675083:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675094:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050235.675178:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3647:x1875954714720128:12345-0@lo:103:ldlm_bl.0 Request processed in 1940us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050235.675188:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050235.675330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714720128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050235.675377:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050235.675430:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:3644:x1875954714720256:12345-0@lo:103:ldlm_bl.0 Request processed in 2179us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050235.675470:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714720256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050235.675509:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789050235.675646:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae695a00/0x3b8ec5973df58692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5868b expref: 19 pid: 17186 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050235.675660:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714720000:0@lo:104: 00010000:00010000:1.0:1789050235.675676:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675685:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675696:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050235.675715:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba983571200/0x3b8ec5973df58748 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789050235.676822:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789050235.680604:0:18694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789050235.680614:0:18694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789050235.680647:0:18694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789050235.680688:0:18694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789050235.680720:0:18694:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789050235.680737:0:18694:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789050235.682015:0:18694:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050235.682240:0:18694:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789050235.753121:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789050236.714044:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789050236.714051:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba9834d3800 from 9 10000000:01000000:0.0:1789050236.714055:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050236.714094:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050236.714117:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050236.714128:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050236.714153:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050236.714218:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050236.714262:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050236.714353:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720384 00000100:00100000:2.0:1789050236.714361:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720384 00000100:00100000:2.0:1789050236.715308:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789050236.715321:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+19:17189:x1875954714720384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050236.715334:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050236.715349:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5874f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050236.715372:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050236.715382:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050236.715391:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694a00, rc 0) 00000100:00100000:2.0:1789050236.715445:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:17189:x1875954714720384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050236.715452:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789050236.715524:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050236.715540:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050236.715549:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050236.715599:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789050236.715630:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050236.719549:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297240 going to sleep for 11 seconds 00000100:00100000:3.0:1789050236.724203:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720512 00000100:00100000:3.0:1789050236.724217:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720512 00000100:00100000:3.0:1789050236.724294:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789050236.724304:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:17189:x1875954714720512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050236.724331:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050236.724349:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050236.724352:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789050236.724860:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:17189:x1875954714720512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 556us (9226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050236.724868:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789050236.725022:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789050236.725087:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789050236.725108:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050236.725119:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050236.725130:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789050236.725133:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba983e8d000 from 9 10000000:01000000:0.0:1789050236.725136:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050236.725170:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050236.725178:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050236.725187:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050236.725206:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050236.725238:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050236.725275:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050236.725319:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720640 00000100:00100000:3.0:1789050236.725324:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720640 00000100:00100000:3.0:1789050236.725404:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789050236.725412:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:17189:x1875954714720640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050236.725422:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050236.725434:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5875d expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050236.725453:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050236.725463:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050236.725472:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae602c00, rc 0) 00000100:00100000:3.0:1789050236.725510:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714720640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050236.725525:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789050236.725579:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050236.725592:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050236.725602:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050236.725641:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789050236.725669:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050236.726308:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab4297780 going to sleep for 11 seconds 00000100:00100000:0.0:1789050236.726373:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720768 00000100:00100000:0.0:1789050236.726379:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720768 00000100:00100000:0.0:1789050236.726403:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789050236.726409:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714720768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789050236.726423:0:17185:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789050236.726436:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789050236.726439:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789050236.726513:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714720768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050236.726520:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789050236.726579:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714720768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789050236.726623:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789050236.726633:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050236.726641:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1789050236.747151:0:18773:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050236.747329:0:18773:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789050236.778423:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050237.801140:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050238.826118:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050239.849574:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050240.300140:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789050240.622010:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714720896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789050240.622081:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050240.622148:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714720896 00000100:00100000:1.0:1789050240.622154:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714720896 00000100:00100000:1.0:1789050240.622190:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789050240.622208:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714720896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050240.622237:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789050240.622280:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714720896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050240.622287:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789050240.622326:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714720896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050240.622485:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050240.622493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714721024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050240.622521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050240.622547:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721024 00000100:00100000:2.0:1789050240.622550:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721024 00000100:00100000:2.0:1789050240.622575:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050240.622580:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714721024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789050240.622596:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789050240.622625:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714721024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050240.622631:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050240.622654:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714721024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050240.873180:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789050241.141492:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050241.141498:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050241.141501:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050241.141504:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050241.141518:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050241.141521:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050241.141530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050241.141534:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050241.141619:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714721152:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141687:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141725:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714721664:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141777:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050241.141782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714721536:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141804:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141831:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714721280:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141851:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141867:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714721792:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141889:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141905:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789050241.141910:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714721408:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141928:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.141962:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.141985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050241.142010:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721664 00000100:00100000:1.0:1789050241.142017:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721664 00000100:00100000:1.0:1789050241.142062:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721792 00000100:00100000:1.0:1789050241.142075:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721792 00000100:00100000:1.0:1789050241.142097:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721408 00000100:00100000:1.0:1789050241.142100:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721408 00000100:00100000:1.0:1789050241.142110:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721920 00000100:00100000:1.0:1789050241.142112:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721920 00000100:00100000:1.0:1789050241.142136:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050241.142144:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714721664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142194:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714721664:12345-0@lo:400:kworker.0 Request processed in 50us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142201:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050241.142218:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789050241.142224:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714721792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142253:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714721792:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142260:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789050241.142271:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050241.142277:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714721408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142300:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714721408:12345-0@lo:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142306:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050241.142316:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050241.142322:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714721920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142344:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714721920:12345-0@lo:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142349:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050241.142368:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721536 00000100:00100000:1.0:1789050241.142371:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721536 00000100:00100000:1.0:1789050241.142390:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721280 00000100:00100000:1.0:1789050241.142392:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721280 00000100:00100000:1.0:1789050241.142404:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050241.142409:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714721536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142447:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714721536:12345-0@lo:400:kworker.0 Request processed in 38us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142452:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050241.142462:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050241.142468:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714721280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142491:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714721280:12345-0@lo:400:kworker.0 Request processed in 23us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050241.142497:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789050241.142540:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baab78a2300 x1875954714721408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050241.142554:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714721408:0@lo:400:kworker.0 00010000:00080000:1.0:1789050241.142565:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baab78a2680 x1875954714721920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050241.142572:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142580:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714721280:0@lo:400:kworker.0 00010000:00080000:1.0:1789050241.142588:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baab78a3b80 x1875954714721792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050241.142596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714721792:0@lo:400:kworker.0 00000100:00100000:1.0:1789050241.142625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714721536:0@lo:400:kworker.0 00010000:00080000:1.0:1789050241.142634:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baab78a0380 x1875954714721664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050241.142641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714721664:0@lo:400:kworker.0 00000100:00100000:0.0:1789050241.142644:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714721152 00000100:00100000:0.0:1789050241.142648:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714721152 00000100:00100000:0.0:1789050241.142681:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789050241.142688:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3647:x1875954714721152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050241.142738:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3647:x1875954714721152:12345-0@lo:400:kworker.0 Request processed in 51us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050241.142744:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789050241.142782:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050241.142786:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050241.142857:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714721152:0@lo:400:kworker.0 00010000:00010000:0.0:1789050241.904481:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050242.543283:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789050242.926345:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050243.173573:0:19063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789050243.952892:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789050244.734712:0:19115:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789050244.735038:0:19115:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789050244.908339:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050229/real 1789050229] req@ffff8ba981b03b80 x1875954714715136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.908384:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba981b03b80 x1875954714715136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.908396:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050229/real 1789050229] req@ffff8ba981b01c00 x1875954714715264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.908406:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba981b01c00 x1875954714715264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050244.908431:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab9998000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050244.908455:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050244.908459:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714715136:0@lo:8:kworker.0 00000100:00080000:0.0:1789050244.908464:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050244.908470:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050244.908473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714715264:0@lo:8:kworker.0 00000100:00080000:2.0:1789050244.910896:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.910904:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050244.910907:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.910910:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050244.910933:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.910956:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789050244.910961:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baab9998000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050244.910971:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789050244.910978:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789050244.910992:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8baab9998000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050244.911020:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2c380 x1875954714722560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050244.911036:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.911049:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789050244.911051:0:38:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050244.911071:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789050244.911073:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789050244.911079:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789050244.911092:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983f2d500 x1875954714722688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050244.912418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714722048:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.912533:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.912599:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714722816:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.912629:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.912662:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050244.912669:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714722176:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.912697:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.912715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714722944:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.912739:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.912776:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722048 00000100:00100000:0.0:1789050244.912785:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722048 00000100:00100000:0.0:1789050244.912840:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789050244.912850:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3646:x1875954714722048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.912905:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3646:x1875954714722048:12345-0@lo:400:kworker.0 Request processed in 56us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050244.912913:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789050244.912966:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722816 00000100:00100000:0.0:1789050244.912970:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722816 00000100:00100000:0.0:1789050244.912997:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722944 00000100:00100000:0.0:1789050244.913000:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722944 00000100:00100000:0.0:1789050244.913028:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050244.913034:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714722816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.913080:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714722816:12345-0@lo:400:kworker.0 Request processed in 46us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050244.913086:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050244.913098:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789050244.913104:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714722944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.913191:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714722944:12345-0@lo:400:kworker.0 Request processed in 88us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050244.913199:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789050244.913227:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050244.913243:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714722560:0@lo:8:kworker.0 00000100:00100000:0.0:1789050244.913275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.913292:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714722688:0@lo:8:kworker.0 00000100:00100000:0.0:1789050244.913314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789050244.913359:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983f2ea00 x1875954714722944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.913374:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714722944:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.913384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714722048:0@lo:400:kworker.0 00010000:00080000:0.0:1789050244.913393:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983f2f100 x1875954714722816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.913401:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714722816:0@lo:400:kworker.0 00000100:00100000:1.0:1789050244.913841:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714722304:0@lo:400:kworker.0 00000100:00100000:1.0:1789050244.913878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050244.913908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714723072:0@lo:400:kworker.0 00000100:00100000:1.0:1789050244.913929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050244.918885:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714722432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050244.918980:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050244.920566:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722176 00000100:00100000:2.0:1789050244.920588:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722176 00000100:00100000:2.0:1789050244.920667:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722432 00000100:00100000:2.0:1789050244.920672:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722432 00000100:00100000:2.0:1789050244.920698:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050244.920710:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714722176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.920842:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714722176:12345-0@lo:400:kworker.0 Request processed in 134us (8142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.920851:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050244.920873:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050244.920880:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714722432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.920923:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714722432:12345-0@lo:400:kworker.0 Request processed in 43us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.920929:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050244.921015:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714722432:0@lo:400:kworker.0 00000100:00100000:1.0:1789050244.921234:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722560 00000100:00100000:1.0:1789050244.921240:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722560 00000100:00100000:1.0:1789050244.921277:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722688 00000100:00100000:1.0:1789050244.921281:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722688 00000100:00100000:1.0:1789050244.921294:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050244.921300:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714722560:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789050244.921336:0:18698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1789050244.921375:0:18698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df5876b 00002000:00100000:1.0:1789050244.921393:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8baa84b11000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789050244.921397:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789050244.921401:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789050244.921659:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789050244.921692:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8baa84b10800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050244.921748:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714722560:12345-0@lo:8:kworker.0 Request processed in 447us (8472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050244.921755:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050244.921772:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050244.921776:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714722688:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789050244.921790:0:18698:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789050244.927083:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983f2c380 x1875954714722560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050244.927109:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050244.927124:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789050244.927135:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789050244.927141:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789050244.927163:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab9998000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789050244.927196:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789050244.927205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714722560:0@lo:8:kworker.0 00000004:00080000:2.0:1789050244.927248:0:17933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789050244.927371:0:17933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 467125433275ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789050244.927378:0:17933:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789050244.927427:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714722176:0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.932834:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714722304 00000100:00100000:0.0:1789050244.932859:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714722304 00000100:00100000:3.0:1789050244.932864:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723072 00000100:00100000:3.0:1789050244.932880:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723072 00000004:00080000:0.0:1789050244.933003:0:17934:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789050244.933057:0:17934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723328:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789050244.933062:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789050244.933081:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714723072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.933165:0:17934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050244.933195:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714723072:12345-0@lo:400:kworker.0 Request processed in 116us (19261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050244.933204:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050244.933216:0:17934:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050244.933252:0:18700:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789050244.933260:0:18700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789050244.933283:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714723200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050244.933331:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.933396:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789050244.933405:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714722304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050244.933455:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714722304:12345-0@lo:400:kworker.0 Request processed in 51us (19576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050244.933463:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789050244.933603:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050244.941234:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714722688:12345-0@lo:8:kworker.0 Request processed in 19443us (27905us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050244.941254:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050244.941295:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723328 00000100:00100000:1.0:1789050244.941305:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723328 00000100:00100000:1.0:1789050244.941373:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050244.941383:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17934:x1875954714723328:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789050244.941709:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723200 00000100:00100000:1.0:1789050244.941714:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723200 00000100:00100000:1.0:1789050244.941740:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050244.941746:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875954714723200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050244.941767:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000004:00080000:2.0:1789050244.949278:0:17925:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1789050244.950845:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050244.950862:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050244.950868:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714722688:0@lo:8:kworker.0 00010000:00080000:0.0:1789050244.950928:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983f2ed80 x1875954714723072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.950961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714723072:0@lo:400:kworker.0 00010000:00080000:0.0:1789050244.951011:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983f2ca80 x1875954714722304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.951021:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714722304:0@lo:400:kworker.0 00000100:00100000:1.0:1789050244.951480:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875954714723200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9729us (18143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050244.951710:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789050244.951769:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050244.953205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b00380 x1875954714723200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.953235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714723200:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1789050244.955647:0:18698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789050244.955662:0:18698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789050244.955783:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17934:x1875954714723328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14396us (22618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050244.955796:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789050244.959718:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba981b03100 x1875954714723328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789050260 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.959742:0:17934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723328:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789050244.959762:0:17934:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789050244.959841:0:17934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723456:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789050244.959913:0:17934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.962859:0:17934:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050244.963342:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723456 00000100:00100000:1.0:1789050244.963357:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723456 00000100:00100000:1.0:1789050244.963423:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050244.963435:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1875954714723456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789050244.963474:0:18699:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789050244.963576:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1875954714723456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 144us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050244.963597:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789050244.963741:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dcbb80 x1875954714723456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789050260 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.963757:0:17934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723456:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789050244.963771:0:17934:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789050244.963820:0:17934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723584:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789050244.963857:0:17934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.963882:0:17934:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050244.964303:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723584 00000100:00100000:2.0:1789050244.964316:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723584 00000100:00100000:2.0:1789050244.964371:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050244.964380:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17934:x1875954714723584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789050244.964424:0:18700:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789050244.978895:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789050245.036670:0:18695:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789050245.036686:0:18695:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789050245.036910:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17934:x1875954714723584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72527us (73048us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789050245.036928:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789050245.036991:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dcbb80 x1875954714723584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789050260 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050245.037003:0:17934:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789050245.037009:0:17934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17934:1875954714723584:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789050245.037025:0:17934:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789050245.037086:0:17934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1875954714723712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789050245.037124:0:17934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050245.037152:0:17934:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9825c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050245.037186:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723712 00000100:00100000:3.0:1789050245.037193:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723712 00000100:00100000:3.0:1789050245.037231:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050245.037239:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1875954714723712:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789050245.037320:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1875954714723712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050245.037327:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789050245.039403:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaae794700 x1875954714723712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789050261 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050245.039420:0:17934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae794700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1875954714723712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789050245.737637:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050245.737661:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714723840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050245.737735:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050245.738599:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723840 00000100:00100000:1.0:1789050245.738610:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723840 00000100:00100000:1.0:1789050245.738680:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789050245.738692:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714723840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789050245.738731:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789050245.738791:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714723840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050245.738798:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789050245.739305:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714723840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050245.742999:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714723968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050245.743092:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050245.744004:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714723968 00000100:00100000:1.0:1789050245.744013:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714723968 00000100:00100000:1.0:1789050245.744071:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050245.744090:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714723968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789050245.744133:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789050245.744197:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714723968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050245.744204:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050245.744497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714723968:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1789050245.885828:0:19166:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789050245.886109:0:19166:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789050245.995025:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050247.020510:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050248.054875:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050249.067682:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050250.093129:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050250.348066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714724096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789050250.348182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050250.349072:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724096 00000100:00100000:1.0:1789050250.349087:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724096 00000100:00080000:3.0:1789050250.349331:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050250.349598:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050250.349612:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714724096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050250.349653:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789050250.349884:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714724096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 275us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050250.349893:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789050250.350256:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050250.350262:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050250.350265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050250.350268:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050250.350292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050250.350297:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789050250.350301:0:37:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050250.350308:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 467 00000100:00080000:1.0:1789050250.350314:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789050250.350327:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050250.350356:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba983791180 x1875954714724736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050250.350423:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714724352:0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.350471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050250.350514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714724992:0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.350544:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050250.350576:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789050250.350582:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714724480:0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.350604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050250.350622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714725120:0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.350647:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050250.350833:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714724224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050250.350875:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050250.350902:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714724864:0@lo:400:kworker.0 00000100:00100000:2.0:1789050250.350924:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050250.351206:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050250.351223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714724608:0@lo:400:kworker.0 00000100:00100000:2.0:1789050250.351253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050250.351294:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724224 00000100:00100000:2.0:1789050250.351303:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724224 00000100:00100000:2.0:1789050250.351356:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789050250.351368:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3645:x1875954714724224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050250.351428:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3645:x1875954714724224:12345-0@lo:400:kworker.0 Request processed in 63us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050250.351436:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789050250.351491:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714724224:0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.351993:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714724736:0@lo:8:kworker.0 00000100:00100000:1.0:1789050250.352058:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050250.352111:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724352 00000100:00100000:1.0:1789050250.352126:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724352 00000100:00100000:1.0:1789050250.352491:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724608 00000100:00100000:1.0:1789050250.352496:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724608 00000100:00100000:1.0:1789050250.352517:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050250.352525:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714724352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.352582:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714724352:12345-0@lo:400:kworker.0 Request processed in 58us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050250.352589:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050250.352605:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050250.352612:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714724608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050250.352648:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714724608:12345-0@lo:400:kworker.0 Request processed in 37us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050250.352654:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050250.352794:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724736 00000100:00100000:2.0:1789050250.352799:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724736 00000100:00100000:2.0:1789050250.352833:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050250.352839:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875954714724736:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789050250.352864:0:18699:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789050250.353149:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724992 00000100:00100000:0.0:1789050250.353164:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724992 00000100:00100000:0.0:1789050250.353213:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724480 00000100:00100000:0.0:1789050250.353217:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724480 00000100:00100000:0.0:1789050250.353288:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725120 00000100:00100000:0.0:1789050250.353292:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725120 00000100:00100000:0.0:1789050250.353308:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714724864 00000100:00100000:0.0:1789050250.353311:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714724864 00000100:00100000:0.0:1789050250.353326:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789050250.353334:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714724992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050250.353412:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714724992:12345-0@lo:400:kworker.0 Request processed in 79us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.353419:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789050250.353433:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789050250.353578:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714724480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050250.353612:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714724480:12345-0@lo:400:kworker.0 Request processed in 38us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.353620:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789050250.353632:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050250.353638:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714725120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050250.353665:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875954714725120:12345-0@lo:400:kworker.0 Request processed in 28us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.353671:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050250.353681:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050250.353687:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714724864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050250.353716:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875954714724864:12345-0@lo:400:kworker.0 Request processed in 29us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.353722:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789050250.353745:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050250.353749:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050250.353797:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714724608:0@lo:400:kworker.0 00010000:00080000:0.0:1789050250.353816:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983793800 x1875954714724864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050250.353828:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875954714724864:0@lo:400:kworker.0 00010000:00080000:0.0:1789050250.353870:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983790380 x1875954714724480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050250.353880:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714724480:0@lo:400:kworker.0 00010000:00080000:0.0:1789050250.353890:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983791c00 x1875954714725120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050250.353906:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875954714725120:0@lo:400:kworker.0 00000100:00100000:0.0:1789050250.353919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714724352:0@lo:400:kworker.0 00010000:00080000:0.0:1789050250.353928:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba983793100 x1875954714724992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050250.353959:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714724992:0@lo:400:kworker.0 00010000:00080000:3.0:1789050250.354808:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832dd880 x1875954714724096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050250.354838:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714724096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050250.374088:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875954714724736:12345-0@lo:8:kworker.0 Request processed in 21237us (22018us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789050250.374106:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789050250.374908:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050250.374915:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050250.374921:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714724736:0@lo:8:kworker.0 00000040:00080000:1.0:1789050250.548699:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050250.857170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714725248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050250.857237:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050250.857431:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714725376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050250.857467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050250.857500:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725248 00000100:00100000:0.0:1789050250.857507:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725248 00000100:00100000:0.0:1789050250.857547:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725376 00000100:00100000:0.0:1789050250.857550:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725376 00000100:00100000:0.0:1789050250.857563:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789050250.857570:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714725248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050250.857606:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050250.857644:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714725248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.857650:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789050250.857666:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050250.857672:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714725376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789050250.857688:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789050250.857738:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714725376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050250.857745:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050250.858014:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714725376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050250.858230:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714725248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789050251.113290:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050252.142422:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050252.779358:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1789050253.122410:0:19511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789050253.122414:0:19511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789050253.122416:0:19511:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789050253.122683:0:19511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8baa8374f000 00000020:01000004:0.0:1789050253.122699:0:19511:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789050253.122715:0:19511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789050253.122786:0:19511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8baa87724d40) 00000020:00000080:0.0:1789050253.122805:0:19511:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1789050253.162120:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789050253.212515:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789050253.223122:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789050253.224030:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789050253.224317:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789050253.224841:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789050253.225212:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789050253.225477:0:19511:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1789050253.231897:0:19511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789050253.232175:0:19511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789050253.232198:0:19511:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789050253.232209:0:19511:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3b8ec5973df58779 00000020:01000004:2.0:1789050253.232216:0:19511:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789050253.232235:0:19511:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789050253.232238:0:19511:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789050253.232244:0:19511:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789050253.232272:0:19511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789050253.232275:0:19511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789050253.255687:0:19511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789050253.255849:0:19511:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789050253.255854:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789050253.255856:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050253.255857:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050253.255858:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050253.255859:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050253.255860:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050253.255862:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050253.255863:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050253.255865:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789050253.255868:0:19511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789050253.255871:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789050253.255872:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050253.255873:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050253.255874:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050253.255875:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050253.255876:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050253.255877:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050253.255878:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050253.255879:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789050253.255905:0:19511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789050253.255926:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789050253.256230:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.256319:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.256807:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725504 00000100:00100000:0.0:1789050253.256816:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725504 00000100:00100000:0.0:1789050253.256899:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789050253.256907:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:19511:x1875954714725504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050253.256962:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789050253.256965:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789050253.256969:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789050253.257350:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:19511:x1875954714725504:12345-0@lo:253:mount.lustre.0 Request processed in 442us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.257360:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789050253.257432:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789050253.257455:0:19511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789050253.257458:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789050253.257460:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050253.257461:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050253.257462:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050253.257463:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050253.257464:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050253.257466:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050253.257467:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050253.257468:0:19511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789050253.257488:0:19511:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8baa8374f000 from lustre-OST0001 10000000:01000000:3.0:1789050253.257514:0:19511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789050253.257526:0:19511:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789050253.257534:0:19511:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8baa857acd40 local copy 00010000:00010000:3.0:1789050253.257561:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050253.257649:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.257680:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.259766:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8874a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.259998:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725632 00000100:00100000:2.0:1789050253.260007:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725632 00000100:00100000:3.0:1789050253.260109:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789050253.260119:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:19511:x1875954714725632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.260278:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:19511:x1875954714725632:12345-0@lo:501:mount.lustre.0 Request processed in 162us (2597us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050253.260284:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789050253.260389:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725632:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789050253.260403:0:19511:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789050253.260424:0:19511:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789050253.260431:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.260439:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8ba983571800/0x3b8ec5973df58493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df5849a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050253.260460:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8baa8374f000 10000000:01000000:2.0:1789050253.260463:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789050253.260467:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789050253.260468:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789050253.260472:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789050253.260474:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789050253.260507:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.260513:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.260529:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.260543:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050253.260568:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.260590:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9825c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.260782:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725760 00000100:00100000:0.0:1789050253.260786:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725760 00000100:00100000:0.0:1789050253.260835:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789050253.260840:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:19511:x1875954714725760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050253.260847:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050253.260856:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1a00/0x3b8ec5973df58787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58780 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050253.260878:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1a00/0x3b8ec5973df58787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58780 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050253.260885:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1a00/0x3b8ec5973df58787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58780 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050253.260891:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1a00, rc 0) 00000100:00100000:0.0:1789050253.260922:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714725760:12345-0@lo:101:mount.lustre.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.260926:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789050253.261016:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050253.261030:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58787 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.261039:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58787 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050253.264035:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789050253.264823:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050253.266899:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789050253.266994:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789050253.267014:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789050253.267031:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789050253.267046:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789050253.267058:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789050253.267080:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789050253.267085:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789050253.267183:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.267235:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.267275:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.267532:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714725888 00000100:00100000:0.0:1789050253.267546:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714725888 00000100:00100000:0.0:1789050253.267604:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789050253.267613:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714725888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050253.268014:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714725888:12345-0@lo:501:mount.lustre.0 Request processed in 401us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.268021:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789050253.268081:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714725888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.268120:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050253.268166:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050253.268233:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726016 00000100:00100000:3.0:1789050253.268240:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050253.268240:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726016 00000100:00100000:1.0:1789050253.268282:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789050253.268290:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050253.271098:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726016:12345-0@lo:503:mount.lustre.0 Request processed in 2798us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050253.271121:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789050253.271393:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050253.272171:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050253.272255:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050253.272317:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.272354:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.272457:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726144 00000100:00100000:2.0:1789050253.272465:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726144 00000100:00100000:2.0:1789050253.272510:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789050253.272518:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050253.273633:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726144:12345-0@lo:502:mount.lustre.0 Request processed in 1111us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.273644:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789050253.274687:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.275006:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789050253.275040:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789050253.275063:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789050253.275095:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789050253.275123:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789050253.275140:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789050253.275154:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789050253.275168:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789050253.275183:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789050253.275221:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050253.275278:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.275327:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789050253.275691:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726272 00000100:00100000:1.0:1789050253.275700:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726272 00000100:00100000:1.0:1789050253.275766:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789050253.275775:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050253.275900:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726272:12345-0@lo:502:mount.lustre.0 Request processed in 126us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050253.275909:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789050253.278405:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.278519:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789050253.278535:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789050253.281088:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789050253.281099:0:19515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789050253.281107:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050253.281110:0:19515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789050253.281117:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050253.281130:0:19515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8baab4e3cd40) 00000020:00000080:1.0:1789050253.281158:0:19515:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789050253.281175:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789050253.281258:0:19515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa8374f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789050253.281267:0:19515:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789050253.281274:0:19515:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3b8ec5973df58795 00010000:00010000:0.0:1789050253.287500:0:19515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789050253.289192:0:19515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789050253.293135:0:19515:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789050253.297886:0:19515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789050253.297901:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050253.297910:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050253.297911:0:19515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789050253.297916:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050253.297926:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050253.297928:0:19515:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789050253.297931:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789050253.297934:0:19515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789050253.297949:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050253.297952:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050253.297953:0:19515:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789050253.297955:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050253.297958:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050253.297959:0:19515:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789050253.297962:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789050253.298003:0:19515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050253.298006:0:19515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050253.298007:0:19515:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789050253.298010:0:19515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789050253.298304:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789050253.298336:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789050253.298361:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58787 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.298375:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694600/0x3b8ec5973df58780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58787 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050253.298392:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baa8374f000 from 1 10000000:01000000:3.0:1789050253.298395:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050253.298432:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.298451:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.298461:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050253.298486:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050253.298564:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.298610:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050253.299470:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726400 00000100:00100000:3.0:1789050253.299480:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726400 00000100:00100000:3.0:1789050253.299586:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789050253.299596:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:19511:x1875954714726400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050253.299612:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050253.299625:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5879c expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.299650:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.299661:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050253.299684:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae603600, rc 0) 00000100:00100000:3.0:1789050253.299759:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726400:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050253.299766:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789050253.299896:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050253.299913:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.299922:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050253.305299:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789050253.305826:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050253.306375:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789050253.306405:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789050253.306426:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789050253.308271:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789050253.308388:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.308685:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050253.308834:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726528 00000100:00100000:0.0:1789050253.308842:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726528 00000100:00100000:0.0:1789050253.308899:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789050253.308909:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050253.309072:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726528:12345-0@lo:501:mount.lustre.0 Request processed in 163us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050253.309300:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050253.309325:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050253.309361:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050253.309401:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.310063:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.310317:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789050253.310354:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726656 00000100:00100000:0.0:1789050253.310360:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726656 00000100:00100000:2.0:1789050253.310925:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789050253.310961:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050253.311234:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726656:12345-0@lo:503:mount.lustre.0 Request processed in 300us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.311242:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789050253.311359:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050253.312034:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050253.312250:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050253.312302:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.312335:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.312870:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726784 00000100:00100000:2.0:1789050253.312879:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726784 00000100:00100000:2.0:1789050253.312928:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789050253.312957:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050253.313618:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726784:12345-0@lo:502:mount.lustre.0 Request processed in 678us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.313626:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789050253.313835:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.314922:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789050253.315009:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789050253.315026:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789050253.315040:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789050253.315054:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789050253.315067:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789050253.315091:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789050253.315107:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789050253.316956:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789050253.316976:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789050253.317003:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789050253.317053:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050253.317692:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.318852:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab0fd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.319200:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714726912 00000100:00100000:2.0:1789050253.319209:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714726912 00000100:00100000:2.0:1789050253.319268:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050253.319278:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050253.319432:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714726912:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.319441:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789050253.322124:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714726912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.322241:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789050253.322255:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789050253.325072:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050253.325085:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325087:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789050253.325095:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baa8374f000 00000020:00000080:3.0:1789050253.325097:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050253.325105:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050253.325119:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325120:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789050253.325123:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050253.325125:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325127:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789050253.325129:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8baa8374f000 00000020:00000080:3.0:1789050253.325131:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050253.325184:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050253.325188:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325202:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789050253.325205:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050253.325207:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325209:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050253.325213:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baa8374f000 00000020:00000080:3.0:1789050253.325215:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050253.325235:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050253.325238:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325239:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789050253.325242:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050253.325244:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325245:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789050253.325248:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8baa8374f000 00000020:00000080:3.0:1789050253.325250:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789050253.325272:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050253.325275:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050253.325276:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789050253.325279:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789050253.325416:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789050253.325460:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050253.325485:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325497:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050253.325563:0:19511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789050253.325566:0:19511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8baa8374f000 10000000:01000000:2.0:1789050253.325569:0:19511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8baa8374f000 10000000:01000000:2.0:1789050253.325572:0:19511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789050253.325578:0:19511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8baa8374f000 from 1 10000000:01000000:2.0:1789050253.325581:0:19511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789050253.325615:0:19511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325623:0:19511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325642:0:19511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.325666:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050253.325729:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.325771:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727040 00000100:00100000:2.0:1789050253.325778:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727040 00000100:00100000:2.0:1789050253.325819:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050253.325829:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:19511:x1875954714727040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050253.325841:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050253.325854:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695000/0x3b8ec5973df587b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df587aa expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325876:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695000/0x3b8ec5973df587b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df587aa expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325887:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695000/0x3b8ec5973df587b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df587aa expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.325895:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695000, rc 0) 00000100:00100000:2.0:1789050253.325927:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727040:12345-0@lo:101:mount.lustre.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.325933:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050253.326029:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa203ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.326052:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050253.326066:0:19511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587b1 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.326085:0:19511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df587b1 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050253.337052:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789050253.337704:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050253.337912:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789050253.337959:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789050253.337978:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789050253.338007:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789050253.338022:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789050253.338036:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789050253.338050:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789050253.338090:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789050253.338107:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789050253.338122:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789050253.338135:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789050253.338149:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789050253.338430:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789050253.338452:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789050253.338467:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789050253.338479:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789050253.338492:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789050253.338505:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789050253.338519:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789050253.338532:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789050253.338545:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789050253.339299:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789050253.339314:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789050253.339342:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789050253.339356:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789050253.339370:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789050253.339393:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789050253.339406:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789050253.339420:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789050253.339434:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789050253.339447:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789050253.339460:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789050253.339473:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789050253.339486:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789050253.339500:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789050253.339513:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789050253.339526:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789050253.339538:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789050253.340449:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789050253.340494:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789050253.340512:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789050253.340526:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789050253.340538:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789050253.340563:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789050253.340578:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789050253.340589:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789050253.340613:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789050253.340619:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1789050253.340729:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050253.341043:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050253.341103:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727168 00000100:00100000:0.0:1789050253.341113:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727168 00000100:00100000:2.0:1789050253.341191:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789050253.341204:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050253.341339:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727168:12345-0@lo:501:mount.lustre.0 Request processed in 138us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.341347:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789050253.341386:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.341410:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050253.341448:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050253.341488:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.341517:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727296 00000100:00100000:0.0:1789050253.341519:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae6b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.341522:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727296 00000100:00100000:2.0:1789050253.341673:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789050253.341682:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050253.341780:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727296:12345-0@lo:503:mount.lustre.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.341787:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789050253.342244:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050253.342711:0:19511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050253.342795:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050253.343099:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050253.343131:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaae9f73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.343727:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727424 00000100:00100000:2.0:1789050253.343735:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727424 00000100:00100000:2.0:1789050253.343789:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789050253.343799:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050253.343919:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727424:12345-0@lo:502:mount.lustre.0 Request processed in 121us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.343927:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789050253.345997:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050253.346317:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789050253.346352:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789050253.346368:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789050253.346380:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789050253.346390:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789050253.346401:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789050253.346411:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789050253.346423:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789050253.346434:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789050253.346445:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789050253.346456:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789050253.346466:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789050253.346476:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789050253.346487:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789050253.346497:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789050253.346524:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789050253.348221:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789050253.348268:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789050253.348284:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789050253.348297:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789050253.348310:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789050253.348324:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789050253.348339:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789050253.348353:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789050253.348365:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789050253.348376:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789050253.348389:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789050253.348401:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789050253.348412:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789050253.348423:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789050253.348447:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789050253.348473:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789050253.348488:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789050253.348500:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789050253.348512:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789050253.348524:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789050253.349012:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789050253.349037:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789050253.349049:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789050253.349059:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789050253.349070:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789050253.349082:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789050253.349095:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789050253.350214:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789050253.350271:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789050253.350289:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789050253.350304:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789050253.350338:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789050253.350406:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050253.350490:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.350748:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8874a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050253.351255:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727552 00000100:00100000:0.0:1789050253.351264:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727552 00000100:00100000:0.0:1789050253.351315:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789050253.351325:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050253.351455:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727552:12345-0@lo:502:mount.lustre.0 Request processed in 130us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.351462:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789050253.367769:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.368107:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789050253.368137:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789050253.368176:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050253.368245:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050253.368288:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.368850:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727680 00000100:00100000:2.0:1789050253.368858:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727680 00000100:00100000:2.0:1789050253.368916:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789050253.368932:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050253.369091:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714727680:12345-0@lo:502:mount.lustre.0 Request processed in 159us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.369098:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050253.371783:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714727680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050253.371884:0:19511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789050253.371899:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789050253.373063:0:19524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789050253.373079:0:19524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8baabeef8000) 00000020:00000080:3.0:1789050253.373120:0:19524:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789050253.373204:0:19524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa8374f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789050253.373208:0:19524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baa8374f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789050253.373211:0:19524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baa8374f000 3 00010000:00080000:3.0:1789050253.373240:0:19524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baa84b14800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789050253.378269:0:19524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789050253.378481:0:19524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789050253.378529:0:19524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789050253.380210:0:19524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3b8ec5973df587bf 00000100:00080000:3.0:1789050253.380225:0:19524:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050253.380237:0:19524:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8baa84b14800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050253.380275:0:19524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba9832dce00 x1875954714727808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050253.380301:0:19524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789050253.380349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050253.380352:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050253.380355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050253.380357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050253.380379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050253.380382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789050253.380384:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050253.380388:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1789050253.380391:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789050253.380395:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789050253.380406:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba9832dc380 x1875954714728448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050253.380462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714727936:0@lo:400:kworker.0 00000100:00100000:3.0:1789050253.380520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050253.381374:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714727808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789050253.389217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050253.389281:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714728448:0@lo:8:kworker.0 00000100:00100000:1.0:1789050253.389329:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.389715:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728448 00000100:00100000:2.0:1789050253.389726:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728448 00000100:00100000:2.0:1789050253.389772:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050253.389779:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875954714728448:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789050253.389860:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875954714728448:12345-0@lo:8:kworker.0 Request processed in 79us (529us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789050253.389868:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050253.389913:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789050253.389921:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050253.389925:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789050253.389928:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714728448:0@lo:8:kworker.0 00000100:00100000:0.0:1789050253.390661:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727808 00000100:00100000:0.0:1789050253.390676:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727808 00000100:00100000:0.0:1789050253.390719:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050253.390726:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875954714727808:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789050253.390744:0:17192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1789050253.390775:0:17192:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3b8ec5973df587c6 00000004:00100000:0.0:1789050253.390790:0:17192:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789050253.390821:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8baa83749800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050253.390883:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875954714727808:12345-0@lo:38:llog_process_th.0 Request processed in 156us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.390890:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789050253.390924:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832dce00 x1875954714727808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050253.390953:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050253.390960:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789050253.390967:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789050253.390971:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789050253.390973:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa84b14800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050253.390978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875954714727808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789050253.392030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714728192:0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392082:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.392121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714728832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392146:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.392173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050253.392179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714728320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.392230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714728064:0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392253:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.392269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714728704:0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.392335:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728320 00000100:00100000:2.0:1789050253.392343:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728320 00000100:00100000:2.0:1789050253.392386:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050253.392394:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714728320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392438:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714728320:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.392444:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050253.392463:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728832 00000100:00100000:2.0:1789050253.392467:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728832 00000100:00100000:2.0:1789050253.392485:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728064 00000100:00100000:2.0:1789050253.392488:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728064 00000100:00100000:2.0:1789050253.392499:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728704 00000100:00100000:2.0:1789050253.392501:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728704 00000100:00100000:2.0:1789050253.392515:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789050253.392522:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714728832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392686:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714728832:12345-0@lo:400:kworker.0 Request processed in 165us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.392693:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789050253.392706:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050253.392711:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714728064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392742:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714728064:12345-0@lo:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.392748:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050253.392760:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050253.392765:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714728704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.392788:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714728704:12345-0@lo:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.392801:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789050253.392839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832dfb80 x1875954714728320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050253.392853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714728320:0@lo:400:kworker.0 00010000:00080000:2.0:1789050253.392866:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832dea00 x1875954714728832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050253.392874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714728832:0@lo:400:kworker.0 00010000:00080000:2.0:1789050253.392899:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832de680 x1875954714728064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050253.392906:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714728064:0@lo:400:kworker.0 00010000:00080000:2.0:1789050253.392914:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832dd500 x1875954714728704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050253.392921:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714728704:0@lo:400:kworker.0 00000100:00100000:0.0:1789050253.393054:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714727936 00000100:00100000:0.0:1789050253.393059:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714727936 00000100:00100000:0.0:1789050253.393095:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728192 00000100:00100000:0.0:1789050253.393098:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728192 00000100:00100000:0.0:1789050253.393124:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050253.393131:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714727936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050253.393170:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714727936:12345-0@lo:400:kworker.0 Request processed in 40us (12650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.393186:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050253.393202:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789050253.393208:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714728192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050253.393244:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714728192:12345-0@lo:400:kworker.0 Request processed in 37us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.393250:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789050253.393268:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050253.393272:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050253.393274:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050253.393292:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714728192:0@lo:400:kworker.0 00000100:00100000:3.0:1789050253.393630:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714727936:0@lo:400:kworker.0 00000100:00100000:3.0:1789050253.393639:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714728576:0@lo:400:kworker.0 00000100:00100000:3.0:1789050253.393669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.393768:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728576 00000100:00100000:2.0:1789050253.393773:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728576 00000100:00100000:2.0:1789050253.393796:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789050253.393802:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714728576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050253.393845:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714728576:12345-0@lo:400:kworker.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.393851:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:01000004:0.0:1789050253.394018:0:19524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789050253.394034:0:19524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8baa87720000) 00000020:00000080:0.0:1789050253.394056:0:19524:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789050253.394781:0:19524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8baa8374f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789050253.394786:0:19524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8baa8374f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789050253.394789:0:19524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8baa8374f000 3 00010000:00080000:0.0:1789050253.394818:0:19524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8baa84b11800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.142@tcp at head 00010000:00080000:3.0:1789050253.395250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba9832ded80 x1875954714728576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050253.395264:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714728576:0@lo:400:kworker.0 00010000:00010000:0.0:1789050253.398111:0:19524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789050253.398325:0:19524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789050253.398371:0:19524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789050253.398384:0:19524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x3b8ec5973df587d4 00000100:00080000:0.0:1789050253.398395:0:19524:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789050253.398406:0:19524:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8baa84b11800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789050253.398440:0:19524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baaa7dca680 x1875954714728960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050253.398461:0:19524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789050253.400721:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714728960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050253.400796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050253.400842:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714728960 00000100:00100000:0.0:1789050253.400850:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714728960 00000100:00100000:0.0:1789050253.400887:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050253.400894:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875954714728960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789050253.400924:0:17194:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1789050253.400975:0:17194:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x3b8ec5973df587db 00000100:00080000:3.0:1789050253.401292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050253.401298:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050253.401301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050253.401304:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00100000:0.0:1789050253.402028:0:17194:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789050253.402067:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8baa848e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050253.402203:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875954714728960:12345-0@lo:38:llog_process_th.0 Request processed in 1306us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050253.402213:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789050253.402276:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8baaa7dca680 x1875954714728960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050253.402287:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050253.402295:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789050253.402302:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789050253.402307:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789050253.402310:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa84b11800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050253.402316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875954714728960:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789050253.403352:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789050253.403458:0:19511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789050253.403491:0:19511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789050253.403514:0:19511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587b1 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050253.403549:0:19511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae695a00/0x3b8ec5973df587aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df587b1 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789050253.403598:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789050253.403600:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789050253.403602:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050253.403603:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050253.403604:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050253.403606:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050253.403608:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050253.403609:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050253.403611:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789050253.403615:0:19511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789050253.403617:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789050253.403618:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789050253.403619:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050253.403620:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050253.403621:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050253.403623:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050253.403624:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050253.403624:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050253.403625:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789050253.403646:0:19511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789050253.403665:0:19511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714729088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789050253.403718:0:19511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050253.403745:0:19511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa236c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.404921:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729088 00000100:00100000:2.0:1789050253.404933:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729088 00000100:00100000:2.0:1789050253.405016:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789050253.405035:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714729088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789050253.405066:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789050253.405078:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789050253.410689:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789050253.410704:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789050253.410772:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789050253.410776:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789050253.410798:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.410815:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.410823:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.410830:0:17208:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.410867:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.410881:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 24 pid: 17186 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.410895:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714729216:0@lo:104: 00000100:00100000:2.0:1789050253.410977:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050253.411032:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411040:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 24 pid: 17185 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.411056:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714729344:0@lo:104: 00000100:00100000:2.0:1789050253.411078:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.411095:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050253.411357:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729216 00000100:00100000:2.0:1789050253.411365:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729216 00000100:00100000:2.0:1789050253.411397:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729344 00000100:00100000:2.0:1789050253.411400:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729344 00000100:00100000:2.0:1789050253.411413:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050253.411421:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:17208:x1875954714729216:12345-0@lo:104: 00010000:00010000:2.0:1789050253.411433:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411500:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050253.411506:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:17208:x1875954714729216:12345-0@lo:104: Request processed in 87us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.411513:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050253.411530:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050253.411535:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714729344:12345-0@lo:104: 00010000:00010000:2.0:1789050253.411618:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411655:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789050253.411661:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:17208:x1875954714729344:12345-0@lo:104: Request processed in 126us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.411667:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050253.411726:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:19511:x1875954714729088:12345-0@lo:253:mount.lustre.0 Request processed in 6693us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.411743:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789050253.411787:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714729216:0@lo:104: 00000100:00100000:2.0:1789050253.411796:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1875954714729344:0@lo:104: 00010000:00010000:2.0:1789050253.411812:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411829:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050253.411834:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411841:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050253.411845:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411853:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050253.411860:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050253.411865:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789050253.411892:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411899:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050253.411919:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411926:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa86db0600/0x3b8ec5973df5875d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58764 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411964:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050253.411967:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411973:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0000 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050253.411976:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.411997:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050253.412004:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050253.412009:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789050253.412022:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412028:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050253.412042:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412049:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baa86db0000/0x3b8ec5973df5874f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58756 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412061:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050253.412063:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050253.412064:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050253.412071:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050253.412089:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050253.412101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714729472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050253.412142:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.412173:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050253.412180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714729600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050253.412202:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050253.412230:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729472 00000100:00100000:2.0:1789050253.412235:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729472 00010000:00010000:2.0:1789050253.412252:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 24 pid: 17186 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.412271:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729600 00000100:00100000:2.0:1789050253.412274:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729600 00010000:00010000:2.0:1789050253.412284:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 25 pid: 17185 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.412295:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050253.412302:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9e852cd-105e-4a2b-8f2f-088fc33df062+25:3644:x1875954714729472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050253.412312:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050253.412316:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 25 pid: 17186 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412325:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 25 pid: 17186 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412337:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae602c00/0x3b8ec5973df58764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5875d expref: 25 pid: 17186 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412350:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050253.412377:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3644:x1875954714729472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.412390:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050253.412402:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050253.412408:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:3647:x1875954714729600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050253.412415:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050253.412419:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 23 pid: 17185 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412426:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 23 pid: 17185 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412436:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae694a00/0x3b8ec5973df58756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5874f expref: 23 pid: 17185 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412446:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412455:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789050253.412467:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005424052s 00010000:00010000:2.0:1789050253.412472:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412479:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412485:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412492:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412503:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050253.412507:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412514:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.412528:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.414053:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050253.414205:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3647:x1875954714729600:12345-0@lo:103:ldlm_bl.0 Request processed in 1792us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050253.414216:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050253.414279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714729472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050253.414308:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.414318:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050253.414324:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae694c00/0x3b8ec5973df587e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050253.414364:0:19511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9e852cd-105e-4a2b-8f2f-088fc33df062:19511:1875954714729088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050253.414375:0:19511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789050253.414378:0:19511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050253.414379:0:19511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050253.414388:0:19511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050253.414389:0:19511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050253.414390:0:19511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050253.414392:0:19511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050253.414393:0:19511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050253.414395:0:19511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050253.414396:0:19511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789050253.414408:0:19511:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789050253.414635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714729600:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789050253.426275:0:19511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789050253.439226:0:19511:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789050253.439235:0:19511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789050253.439273:0:19511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789050253.439321:0:19511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789050253.439339:0:19511:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789050253.439362:0:19511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789050253.443284:0:19511:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789050253.443525:0:19511:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789050254.186180:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050254.444022:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050233/real 1789050233] req@ffff8baab78a3800 x1875954714716032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.444058:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8baab78a3800 x1875954714716032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.444098:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050233/real 1789050233] req@ffff8baab78a2d80 x1875954714716160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.444113:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8baab78a2d80 x1875954714716160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789050254.444133:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050254.444145:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789050254.444149:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714716032:0@lo:8:kworker.0 00000100:00080000:3.0:1789050254.444154:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789050254.444159:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789050254.444173:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714716160:0@lo:8:kworker.0 00000100:00080000:1.0:1789050254.444489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050254.444494:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789050254.444496:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050254.444501:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1789050254.444511:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789050254.444521:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8baab771c000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050254.444541:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a3800 x1875954714729984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050254.444552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050254.444554:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789050254.444556:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050254.444559:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1789050254.444561:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789050254.444565:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8baab0ea1800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050254.444574:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baab78a3b80 x1875954714730112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050254.444598:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050254.444601:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789050254.444603:0:36:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050254.444608:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8baa85745000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789050254.444617:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8baa85708380 x1875954714730624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050254.444663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714729856:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.444720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.444749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714730752:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.444772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.444802:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714731264:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.444824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.444851:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789050254.444857:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714730240:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.444878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.444893:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714730880:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.444910:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.444932:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729856 00000100:00100000:1.0:1789050254.444961:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729856 00000100:00100000:1.0:1789050254.445013:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050254.445022:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714729856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445086:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714729856:12345-0@lo:400:kworker.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.445093:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050254.445117:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730752 00000100:00100000:1.0:1789050254.445120:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730752 00000100:00100000:1.0:1789050254.445138:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731264 00000100:00100000:1.0:1789050254.445141:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731264 00000100:00100000:1.0:1789050254.445174:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730240 00000100:00100000:1.0:1789050254.445177:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730240 00000100:00100000:1.0:1789050254.445191:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730880 00000100:00100000:1.0:1789050254.445193:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730880 00000100:00100000:1.0:1789050254.445205:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050254.445210:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714730752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445242:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875954714730752:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.445247:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050254.445259:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789050254.445264:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714731264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445290:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875954714731264:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.445302:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789050254.445314:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050254.445319:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714730240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445346:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714730240:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.445351:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050254.445362:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789050254.445367:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714730880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445392:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714730880:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.445397:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789050254.445421:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789050254.445443:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708000 x1875954714730240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.445455:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714730240:0@lo:400:kworker.0 00010000:00080000:1.0:1789050254.445466:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709500 x1875954714730880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.445474:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714730880:0@lo:400:kworker.0 00000100:00100000:1.0:1789050254.445484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714729856:0@lo:400:kworker.0 00010000:00080000:1.0:1789050254.445491:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708a80 x1875954714730752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.445499:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875954714730752:0@lo:400:kworker.0 00010000:00080000:1.0:1789050254.445506:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570ad80 x1875954714731264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.445520:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875954714731264:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446234:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714730496:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714731136:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446366:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789050254.446373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714730368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446394:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714731008:0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446466:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730368 00000100:00100000:3.0:1789050254.446480:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730368 00000100:00100000:3.0:1789050254.446513:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789050254.446520:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714730368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446563:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714730368:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.446570:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789050254.446587:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731136 00000100:00100000:3.0:1789050254.446590:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731136 00000100:00100000:3.0:1789050254.446617:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731008 00000100:00100000:3.0:1789050254.446620:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731008 00000100:00100000:3.0:1789050254.446633:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050254.446639:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714731136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446668:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714731136:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.446673:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050254.446684:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789050254.446689:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714731008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.446715:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875954714731008:12345-0@lo:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.446721:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789050254.446737:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050254.446747:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714729984:0@lo:8:kworker.0 00000100:00100000:3.0:1789050254.446776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446810:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714730112:0@lo:8:kworker.0 00000100:00100000:3.0:1789050254.446833:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446849:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714730624:0@lo:8:kworker.0 00000100:00100000:3.0:1789050254.446883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.446914:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730496 00000100:00100000:3.0:1789050254.446918:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730496 00000100:00100000:3.0:1789050254.446956:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729984 00000100:00100000:3.0:1789050254.446959:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729984 00000100:00100000:3.0:1789050254.446969:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730112 00000100:00100000:3.0:1789050254.446971:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730112 00000100:00100000:3.0:1789050254.446991:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714730624 00000100:00100000:3.0:1789050254.446993:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714730624 00000100:00100000:3.0:1789050254.447001:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050254.447007:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714730496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050254.447034:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714730496:12345-0@lo:400:kworker.0 Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.447039:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050254.447050:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050254.447054:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714729984:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050254.447088:0:18698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1789050254.447113:0:18698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df587e9 00002000:00100000:3.0:1789050254.447125:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8baab4110800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789050254.447129:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789050254.447132:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789050254.447202:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789050254.447225:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8baa8374e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050254.447262:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875954714729984:12345-0@lo:8:kworker.0 Request processed in 206us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.447269:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050254.447280:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050254.447284:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714730112:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050254.447308:0:18698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1789050254.447323:0:18698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3b8ec5973df587f0 00002000:00100000:3.0:1789050254.447330:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8baa848e6000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789050254.447332:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789050254.447334:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789050254.447469:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789050254.447484:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8baa848c3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050254.447512:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875954714730112:12345-0@lo:8:kworker.0 Request processed in 227us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.447519:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050254.447532:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050254.447536:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875954714730624:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050254.447549:0:18698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1789050254.447563:0:18698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3b8ec5973df587f7 00002000:00100000:3.0:1789050254.447568:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8baa848c0800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789050254.447572:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789050254.447574:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789050254.447591:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789050254.447601:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8baa848c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050254.447625:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875954714730624:12345-0@lo:8:kworker.0 Request processed in 88us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.447631:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050254.447673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714730368:0@lo:400:kworker.0 00010000:00080000:3.0:1789050254.447686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570aa00 x1875954714731008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.447709:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875954714731008:0@lo:400:kworker.0 00010000:00080000:3.0:1789050254.447722:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570b800 x1875954714730496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.447730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714730496:0@lo:400:kworker.0 00010000:00080000:3.0:1789050254.447739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85709880 x1875954714731136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.447746:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714731136:0@lo:400:kworker.0 00010000:00080000:3.0:1789050254.447784:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a3800 x1875954714729984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.447791:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789050254.447797:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789050254.447805:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789050254.447810:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789050254.447812:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab771c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789050254.447833:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789050254.447837:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714729984:0@lo:8:kworker.0 00000004:00080000:0.0:1789050254.447845:0:17217:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1789050254.447848:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a3b80 x1875954714730112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050254.447853:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789050254.447857:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789050254.447861:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789050254.447863:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789050254.447865:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baab0ea1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789050254.447883:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789050254.447887:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875954714730112:0@lo:8:kworker.0 00010000:00080000:3.0:1789050254.447900:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708380 x1875954714730624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789050254.447905:0:17217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 476645967599ns, next at 0ns, rc = 0 00000100:00080000:3.0:1789050254.447908:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00080000:00080000:0.0:1789050254.447910:0:17217:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1789050254.447912:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789050254.447915:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789050254.447917:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8baa85745000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789050254.447924:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789050254.447927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875954714730624:0@lo:8:kworker.0 00000004:00080000:3.0:1789050254.448005:0:17220:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789050254.448021:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17220:1875954714731520:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789050254.448047:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.448063:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82cfb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050254.448077:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714731392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050254.448099:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.448125:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731520 00000100:00100000:3.0:1789050254.448129:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731520 00000100:00100000:3.0:1789050254.448157:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050254.448164:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17220:x1875954714731520:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1789050254.448318:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789050254.449989:0:17218:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789050254.450012:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17218:1875954714731776:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789050254.450061:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.450094:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d240 going to sleep for 11 seconds 00000004:00080000:1.0:1789050254.450111:0:17219:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789050254.450196:0:17219:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476648257716ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789050254.450202:0:17219:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789050254.450229:0:17936:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789050254.450243:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732032:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789050254.450268:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.450283:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050254.450299:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731392 00000100:00100000:1.0:1789050254.450306:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731392 00000100:00100000:1.0:1789050254.450347:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050254.450355:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875954714731392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050254.450373:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789050254.450415:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875954714731392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.450421:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050254.450445:0:19123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731776 00000100:00100000:1.0:1789050254.450448:0:19123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731776 00000100:00100000:1.0:1789050254.450475:0:19123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732032 00000100:00100000:1.0:1789050254.450479:0:19123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732032 00000100:00100000:1.0:1789050254.450493:0:19123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789050254.450499:0:19123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17218:x1875954714731776:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789050254.450691:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714731648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050254.450719:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.450740:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050254.450747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714731904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050254.450767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.450804:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731648 00000100:00100000:1.0:1789050254.450808:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731648 00000100:00100000:1.0:1789050254.450824:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714731904 00000100:00100000:1.0:1789050254.450826:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714731904 00000100:00100000:1.0:1789050254.450838:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050254.450844:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875954714731648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050254.450859:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789050254.450916:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875954714731648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.450922:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050254.450954:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050254.450960:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875954714731904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789050254.450970:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789050254.451006:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875954714731904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.451011:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789050254.451033:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050254.451036:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789050254.451062:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba9832de680 x1875954714731392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.451079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714731392:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789050254.451114:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708000 x1875954714731904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.451126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714731904:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789050254.451135:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570ad80 x1875954714731648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050254.451144:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714731648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050254.452032:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714729728 00000100:00100000:2.0:1789050254.452040:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714729728 00000100:00100000:2.0:1789050254.452085:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789050254.452093:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3647:x1875954714729728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050254.452143:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3647:x1875954714729728:12345-0@lo:400:kworker.0 Request processed in 52us (5909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.452150:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:2.0:1789050254.452190:0:17935:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789050254.452255:0:17935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 476650316670ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789050254.452260:0:17935:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789050254.454210:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789050254.454362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714729728:0@lo:400:kworker.0 00002000:00080000:1.0:1789050254.454410:0:19123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789050254.454418:0:19123:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789050254.454423:0:19123:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:3.0:1789050254.461475:0:17925:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789050254.469909:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789050254.474430:0:18698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789050254.474442:0:18698:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789050254.474448:0:18698:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1789050254.496268:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.496293:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.496311:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.496316:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.496323:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.496341:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.496353:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.496361:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.496383:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050254.496710:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.496720:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.496730:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.496735:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.496847:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.496879:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.496888:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df587fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.497023:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.497026:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.497028:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.507851:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.507863:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.507882:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.507886:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.507892:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.507909:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.507919:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.507960:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.507989:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050254.508452:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.508460:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.508469:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.508474:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.508483:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.508500:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.508508:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df58805 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.508535:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.508537:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.508538:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.508828:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.508835:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.508845:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.508849:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.508853:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.508862:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.508870:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.508877:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.508896:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050254.510517:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.510534:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.510547:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.510551:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.510555:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.510569:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.510577:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.510584:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.510604:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050254.510905:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050254.510912:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.510920:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.510924:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.510932:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511123:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511130:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df5880c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511145:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.511148:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511154:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.511310:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511318:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511330:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511338:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcde5156/0x3b8ec5973df58813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.511352:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.511354:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.511355:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.512312:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.512321:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.512332:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.512337:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.512342:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.512352:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.512361:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.512378:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.512398:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050254.513338:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.513348:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.513357:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.513362:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.513373:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.513399:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.513407:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5881a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.513426:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.513428:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.513430:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.513498:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.514096:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.514114:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514127:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.514131:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.514137:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514149:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514158:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514332:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514350:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050254.514362:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.514367:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514380:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.514384:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514393:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514406:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514413:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5f00aea/0x3b8ec5973df58821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514428:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.514430:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.514432:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.514883:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.514890:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514899:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.514902:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.514906:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514915:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.514929:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050254.515512:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.515519:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.515534:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.515537:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.515541:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.515551:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.515559:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.515566:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.515580:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050254.515774:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.515795:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050254.516082:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050254.516089:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516096:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.516100:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516108:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516124:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516131:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003204a40d/0x3b8ec5973df5882f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516143:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.516150:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516156:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.516159:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516175:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516185:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516191:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087327c34/0x3b8ec5973df58828 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516202:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.516204:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.516205:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.516441:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.516858:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.516865:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516876:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.516879:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.516883:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516906:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516915:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516923:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.516957:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050254.517466:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.517472:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.517481:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.517484:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.517488:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.517497:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.517504:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.517520:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.517532:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789050254.517786:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.517793:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517800:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.517803:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.517808:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517818:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517833:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517840:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517854:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789050254.517864:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789050254.517871:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517879:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050254.517883:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517892:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517904:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517911:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b134892d/0x3b8ec5973df58836 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517928:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050254.517951:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517958:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050254.517961:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517969:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517991:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.517998:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df5883d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518010:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050254.518014:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518020:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050254.518023:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518029:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518050:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518057:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58844 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.518082:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.518085:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.518087:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.518318:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.518323:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.520021:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.520031:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520046:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.520050:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.520055:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520078:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520088:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520095:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520118:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050254.520274:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.520285:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520293:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.520297:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520307:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520324:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520331:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000467a228/0x3b8ec5973df5884b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.520348:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.520350:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.520351:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.520709:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.520716:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.520724:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.520727:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.520731:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.520740:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.520748:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.520755:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050254.521121:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.521128:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.521137:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.521140:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.521144:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.521165:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.521173:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.521181:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.523403:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789050254.524307:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.524318:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.524333:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.524338:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.524343:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.524356:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.524366:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.524373:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524479:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789050254.524859:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.524866:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524875:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.524878:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.524882:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524891:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524899:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524916:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.524932:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789050254.525055:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789050254.525062:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525081:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.525086:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525096:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525117:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525124:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58852 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525140:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789050254.525144:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525165:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.525170:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525177:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525190:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525197:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abfbd159/0x3b8ec5973df58859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525211:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050254.525214:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525221:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.525223:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525230:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525239:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525263:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.525267:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525273:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.525276:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525283:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525293:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525299:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61bfc73/0x3b8ec5973df58867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.525310:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.525312:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.525314:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.525320:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.527397:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.527462:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789050254.527472:0:19123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadff198/0x3b8ec5973df58860 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.527787:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.528343:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.528352:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.528366:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.528371:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.528376:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.528400:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.528483:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.528491:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.528515:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050254.529396:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050254.529404:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.529421:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:1.0:1789050254.529425:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.529433:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.529450:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.529456:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058014ce3/0x3b8ec5973df5886e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.529471:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.529473:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.529474:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.529812:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.529819:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.529829:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.529833:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.529838:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.529848:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.529857:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.529874:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.529888:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.530063:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.530070:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530078:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.530082:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530090:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530102:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530110:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f57dd6f/0x3b8ec5973df58875 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530121:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.530123:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.530124:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.530395:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.530407:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530415:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.530418:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1789050254.530420:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.530423:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.530425:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530432:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.530433:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.530436:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.530440:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530441:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530448:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.530450:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.530458:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530462:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050254.530475:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.530488:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050254.530549:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.530554:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530561:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.530565:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530572:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530588:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530596:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009614635a/0x3b8ec5973df5887c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530608:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.530611:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530617:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.530620:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530627:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530640:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530647:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf41620c/0x3b8ec5973df58883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.530661:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.530663:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.530670:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.531000:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.531006:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531014:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.531017:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.531021:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531029:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531035:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531041:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531054:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050254.531153:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.531158:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531178:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.531181:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531189:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531198:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531206:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d78eaa3/0x3b8ec5973df5888a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531219:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.531220:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.531222:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.531500:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.531505:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531512:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.531515:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.531518:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531527:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531538:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531544:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531553:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050254.531822:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.531828:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531836:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.531839:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.531843:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531852:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531858:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531865:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.531889:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050254.532000:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050254.532005:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.532012:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.532016:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532023:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.532024:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532027:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532035:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.532036:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532038:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.532044:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9a4380/0x3b8ec5973df58891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532046:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532056:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.532059:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.532060:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532063:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4e6432/0x3b8ec5973df58898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532074:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532076:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532077:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.532116:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.532121:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532130:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.532133:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.532137:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532152:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532160:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532168:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532177:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.532271:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.532277:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532284:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.532287:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532296:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532307:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532314:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b065e2bd/0x3b8ec5973df5889f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532334:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532336:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532337:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.532412:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.532417:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.532601:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.532607:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532615:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.532618:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.532622:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532631:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532650:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532658:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532670:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.532761:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.532765:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532790:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.532794:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532802:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532813:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532820:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df588a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532833:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532834:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.532836:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.532867:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.532872:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532880:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.532883:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.532887:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532896:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532908:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532916:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.532927:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.533075:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.533079:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533087:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.533090:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533099:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533110:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533118:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e990c003/0x3b8ec5973df588ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533130:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.533136:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.533138:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.533186:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.533192:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533848:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.533852:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.533857:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533868:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533877:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533884:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.533901:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789050254.534064:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.534070:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.534078:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.534080:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.534084:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.534102:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.534110:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.534118:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.534131:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050254.535391:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050254.535402:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535425:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.535429:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535439:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535455:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535462:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df588b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535478:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.535482:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535487:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.535490:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535497:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535505:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535517:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48f49dd/0x3b8ec5973df588bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.535529:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.535530:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.535532:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.535872:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.536025:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.536032:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536044:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.536048:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.536053:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536076:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536092:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536109:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536135:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789050254.536742:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.536748:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536758:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.536761:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.536766:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536775:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536783:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536791:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.536820:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789050254.536949:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.536954:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.536956:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.536960:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.536965:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.536968:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.536968:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.536981:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.536981:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.536992:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.536993:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537001:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537007:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537014:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bdaebc7/0x3b8ec5973df588c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537019:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537029:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050254.537032:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537033:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050254.537045:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.537049:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537056:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537078:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537085:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010edf073/0x3b8ec5973df588d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537098:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.537106:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537114:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.537125:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537131:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.537134:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537143:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537156:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000caf4015/0x3b8ec5973df588c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.537171:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.537173:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.537174:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050254.537625:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.537818:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.537825:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537836:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.537839:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.537843:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537854:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537863:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537871:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.537894:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789050254.538314:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.538329:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538338:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.538341:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.538345:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538356:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538364:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538371:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538386:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050254.538473:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.538479:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538487:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.538492:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538501:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538520:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538528:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c73fa/0x3b8ec5973df588d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538543:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.538546:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538552:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.538554:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538562:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538570:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538577:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985b620a/0x3b8ec5973df588de lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538587:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.538589:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.538596:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789050254.538824:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789050254.538830:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538838:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789050254.538841:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050254.538845:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538853:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538860:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538867:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.538881:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050254.540147:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050254.540158:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.540169:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050254.540173:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.540183:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.540199:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.540207:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004deb8c62/0x3b8ec5973df588e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.540226:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.540228:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.540229:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.541085:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.541313:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.541323:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.541341:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.541346:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.541352:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.541364:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.541374:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.541381:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.541407:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.541769:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.541776:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.541785:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.541789:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.541809:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.541824:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.541832:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcde5156/0x3b8ec5973df588ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.541851:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.541853:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.541855:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.542002:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.542009:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.542017:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.542020:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.542024:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.542045:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.542053:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.542060:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050254.542282:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.542289:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.542297:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.542300:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.542303:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.542312:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.542319:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.542326:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.542382:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789050254.546295:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.546310:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.546329:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.546341:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.546350:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.546368:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.546381:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.546390:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547298:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050254.547308:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547318:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.547323:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547333:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547351:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547370:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadff198/0x3b8ec5973df588fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547385:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.547389:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547395:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695800 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.547398:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547406:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547418:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547425:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.547428:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547434:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.547436:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547454:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547465:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547472:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.547474:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.547476:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050254.547566:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789050254.547573:0:19123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087327c34/0x3b8ec5973df588f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.547993:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.548327:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.548334:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548346:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.548350:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.548355:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548366:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548387:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548394:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548417:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.548674:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.548681:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.548690:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.548694:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.548702:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.548715:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.548722:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f00aea/0x3b8ec5973df58908 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.548751:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.548753:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.548755:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.548828:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.548833:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548842:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.548846:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.548850:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548858:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548866:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548873:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.548904:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.549285:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.549293:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.549301:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.549304:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.549312:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.549324:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.549332:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6302b15/0x3b8ec5973df5890f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.549347:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.549348:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.549350:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050254.549429:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789050254.549434:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.549442:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789050254.549446:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050254.549450:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.549458:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.549467:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.549474:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.549525:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050254.553492:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050254.553506:0:18698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041afd2b6/0x3b8ec5973df58901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050254.553970:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.553986:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.553999:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.554003:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.554009:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554023:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554038:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554046:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554062:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789050254.554428:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.554434:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554442:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.554445:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.554449:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554458:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554466:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554474:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554493:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789050254.554726:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.554732:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554740:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.554743:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.554747:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554755:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554763:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554770:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.554777:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789050254.555033:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.555040:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555048:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.555056:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.555060:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555179:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555188:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555195:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555203:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789050254.555429:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789050254.555437:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555446:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.555458:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555469:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555487:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555493:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cf705a/0x3b8ec5973df58916 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555513:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789050254.555517:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555523:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.555526:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555533:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555542:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555549:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df5891d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555569:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789050254.555573:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555579:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.555583:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555591:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555601:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555608:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f87b13/0x3b8ec5973df58924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555618:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050254.555621:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555628:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.555631:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555649:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555660:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555668:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062af4fe4/0x3b8ec5973df5892b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555680:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050254.555683:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555689:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050254.555692:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555698:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555706:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555713:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6a9a2c/0x3b8ec5973df58932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.555739:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.555740:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.555742:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.555827:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.555832:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555841:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.555844:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.555848:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555857:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555865:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555877:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.555900:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.556268:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.556275:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.556295:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.556298:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.556306:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.556319:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.556326:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003204a40d/0x3b8ec5973df58939 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.556342:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.556343:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.556345:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.556354:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050254.556421:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050254.557367:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.557377:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.557389:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.557393:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.557397:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.557409:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.557418:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.557426:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.557440:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.557832:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.557839:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.557847:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.557852:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.557860:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.557880:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.557887:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010edf073/0x3b8ec5973df58940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.557904:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.557905:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.557907:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.558175:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.558182:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558192:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.558195:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.558200:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558211:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558219:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558227:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558244:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050254.558592:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.558598:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558616:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.558620:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.558625:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558634:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558643:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558649:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.558666:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789050254.558925:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.558931:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.558958:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.558961:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.558965:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.558985:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.558993:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.558999:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.559010:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789050254.559206:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050254.559213:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559221:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.559225:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559234:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559246:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559253:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61bfc73/0x3b8ec5973df58947 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559279:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.559282:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559288:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177200 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.559290:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559298:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559307:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559313:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abfbd159/0x3b8ec5973df5894e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559323:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.559326:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559331:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571a00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.559334:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559351:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559361:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559367:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bdaebc7/0x3b8ec5973df58955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.559379:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.559381:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.559383:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.559390:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050254.560457:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789050254.560467:0:19123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.560479:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1789050254.560483:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050254.560488:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.560498:0:19123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.560517:0:19123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.560524:0:19123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.560542:0:19123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789050254.560599:0:19123:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1789050254.560693:0:19123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17218:x1875954714731776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110190us (110628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.560702:0:19123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050254.560734:0:19123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050254.560745:0:19123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732032:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789050254.561086:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17218:1875954714731776:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789050254.561156:0:17218:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789050254.561200:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17218:1875954714732160:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789050254.561234:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.561258:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8901e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050254.561275:0:18699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789050254.561282:0:18699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:1.0:1789050254.561418:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.561424:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.561449:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.561452:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.561456:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.561467:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.561476:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.561484:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.561498:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050254.561847:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.561855:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561865:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.561869:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561879:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561896:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561914:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000467a228/0x3b8ec5973df5895c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561934:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.561952:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561960:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.561963:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561981:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561992:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.561998:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5a4476f/0x3b8ec5973df58963 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.562011:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.562012:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.562014:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.562020:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050254.562045:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732160 00000100:00100000:0.0:1789050254.562053:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732160 00000100:00100000:0.0:1789050254.563262:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789050254.563274:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17218:x1875954714732160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789050254.563313:0:19575:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:1.0:1789050254.563861:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.563869:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.563882:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.563886:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.563891:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.563903:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.563922:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.563930:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.563964:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050254.564268:0:18345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.564275:0:18345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.564283:0:18345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.564287:0:18345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.564297:0:18345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.564311:0:18345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.564318:0:18345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e990c003/0x3b8ec5973df5896a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.564332:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.564334:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.564335:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789050254.565228:0:19123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789050254.565236:0:19123:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789050254.565335:0:19123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732032:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4587us (115060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.565345:0:19123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789050254.565386:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050254.565455:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732032:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789050254.565471:0:17936:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789050254.565509:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732288:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789050254.565543:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050254.568614:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa851576c0 going to sleep for 11 seconds 00002000:00010000:1.0:1789050254.568692:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.568701:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.568719:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.568724:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.568731:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.568748:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.568757:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.568772:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.568787:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789050254.569329:0:18698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789050254.569336:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.569345:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1789050254.569348:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050254.569352:0:18698:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.569361:0:18698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.569368:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.569374:0:18698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050254.569385:0:18698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1789050254.569416:0:18698:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789050254.569489:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17220:x1875954714731520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 121322us (121437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050254.569505:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050254.569533:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732288 00000100:00100000:1.0:1789050254.569541:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732288 00010000:00010000:0.0:1789050254.570166:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050254.570175:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570196:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.570201:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570211:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570227:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570235:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758f0eb1/0x3b8ec5973df58971 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570253:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050254.570256:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570262:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db0e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050254.570265:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570272:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570282:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570296:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b065e2bd/0x3b8ec5973df58978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.570310:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.570311:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.570313:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050254.570319:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050254.570877:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050254.570890:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732288:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789050254.570918:0:18699:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789050254.571008:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732288:12345-0@lo:5:osp-pre-1-1.0 Request processed in 121us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.571015:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050254.571077:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732288:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789050254.571090:0:17936:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789050254.571140:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732416:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789050254.571171:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050254.571194:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87ec26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050254.571206:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732416 00000100:00100000:2.0:1789050254.571212:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732416 00000100:00100000:2.0:1789050254.571240:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050254.571246:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732416:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789050254.571270:0:18700:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:3.0:1789050254.571779:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17220:1875954714731520:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789050254.571790:0:17220:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789050254.571816:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17220:1875954714732544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789050254.571845:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.571870:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baac20c7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050254.573543:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732544 00000100:00100000:2.0:1789050254.573554:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732544 00000100:00100000:2.0:1789050254.573597:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050254.573607:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17220:x1875954714732544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789050254.573645:0:18699:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 10000000:01000000:0.0:1789050254.574930:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789050254.574948:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba9834d3800 from 10 10000000:01000000:0.0:1789050254.574953:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050254.574997:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.575009:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050254.575020:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050254.575042:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050254.575121:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050254.575158:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa811caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050254.576095:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732672 00000100:00100000:3.0:1789050254.576111:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732672 00000100:00100000:3.0:1789050254.576163:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789050254.576173:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714732672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050254.576188:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050254.576203:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baaae695800/0x3b8ec5973df58986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5897f expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.576225:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baaae695800/0x3b8ec5973df58986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5897f expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.576235:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baaae695800/0x3b8ec5973df58986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5897f expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.576244:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695800, rc 0) 00000100:00100000:3.0:1789050254.576299:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714732672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.576306:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789050254.576354:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050254.576370:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58986 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.576379:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58986 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050254.576441:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789050254.576476:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.576508:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa73cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050254.576627:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732800 00000100:00100000:0.0:1789050254.576632:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732800 00000100:00100000:0.0:1789050254.576663:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789050254.576670:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714732800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789050254.576685:0:17185:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789050254.576704:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789050254.576708:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789050254.576779:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714732800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050254.576786:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789050254.578400:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789050254.578477:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050254.578486:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58986 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.578497:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa829d6a00/0x3b8ec5973df5897f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58986 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050254.578507:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789050254.578509:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba983e8d000 from 10 10000000:01000000:3.0:1789050254.578512:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789050254.578540:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.578548:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.578556:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050254.578575:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050254.578623:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.578664:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa73cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050254.580637:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714732928 00000100:00100000:2.0:1789050254.580650:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714732928 00000100:00100000:2.0:1789050254.580709:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789050254.580719:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714732928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050254.580736:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050254.580752:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2176200/0x3b8ec5973df58994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df5898d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.580781:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2176200/0x3b8ec5973df58994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df5898d expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.580792:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2176200/0x3b8ec5973df58994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5898d expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050254.580807:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176200, rc 0) 00000100:00100000:2.0:1789050254.580869:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714732928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.580876:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050254.581383:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714732928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050254.581403:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58994 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.581413:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58994 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050254.581483:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714733056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789050254.581523:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050254.581561:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa73cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050254.585050:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733056 00000100:00100000:2.0:1789050254.585064:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733056 00000100:00100000:2.0:1789050254.585121:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789050254.585130:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714733056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789050254.585152:0:17187:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789050254.585167:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789050254.585170:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789050254.585285:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714733056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050254.585293:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000001:00080000:2.0:1789050254.588895:0:18695:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789050254.588961:0:18695:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789050254.589348:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17218:x1875954714732160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26071us (28107us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789050254.589358:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789050254.589402:0:17218:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789050254.589410:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17218:1875954714732160:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789050254.589427:0:17218:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1789050254.595445:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714733056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789050254.595513:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050254.595523:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58994 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050254.595535:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694a00/0x3b8ec5973df5898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58994 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050254.597316:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789050254.597352:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789050254.597357:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789050254.598549:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17220:x1875954714732544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24937us (26696us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789050254.598561:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050254.599445:0:17220:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789050254.599455:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17220:1875954714732544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789050254.599473:0:17220:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1789050254.602991:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17936:x1875954714732416:12345-0@lo:5:osp-pre-1-1.0 Request processed in 31739us (31812us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789050254.603005:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000004:2.0:1789050254.603755:0:19578:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789050254.604077:0:19578:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789050254.607762:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17936:1875954714732416:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789050254.607781:0:17936:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789050254.609532:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983790380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1875954714733184:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789050254.609601:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050254.609638:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa87ec2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050254.610624:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733184 00000100:00100000:3.0:1789050254.610633:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733184 00000100:00100000:3.0:1789050254.611522:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050254.611537:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1875954714733184:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789050254.611639:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1875954714733184:12345-0@lo:900:osp-pre-1-1.0 Request processed in 107us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050254.611647:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789050254.611716:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983790380 x1875954714733184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789050270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050254.611730:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983790380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1875954714733184:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789050255.209892:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050255.466107:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050255.466223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714733312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050255.466290:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050255.467808:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733312 00000100:00100000:1.0:1789050255.467821:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733312 00000100:00100000:1.0:1789050255.467957:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050255.469061:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714733312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789050255.469097:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789050255.469179:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714733312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1213us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050255.469187:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050255.469309:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714733312:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789050255.470566:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050255.979103:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050255.979123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714733440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050255.979188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050255.979250:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733440 00000100:00100000:3.0:1789050255.979258:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733440 00000100:00100000:3.0:1789050255.979296:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050255.979303:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714733440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050255.979334:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789050255.979370:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714733440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.979376:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050255.979418:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714733440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050255.986560:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050255.986584:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714733568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050255.986655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050255.986934:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733568 00000100:00100000:3.0:1789050255.987016:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733568 00000100:00100000:3.0:1789050255.987130:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050255.987143:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714733568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050255.987196:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050255.987300:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714733568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.987311:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050255.987358:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba9832dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714733568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789050256.233707:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050257.257196:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050258.284253:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050259.310299:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050259.564263:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714733696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050259.564334:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.564369:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714733824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050259.564408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714734336:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.564425:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564438:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714734848:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.564468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714734208:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564483:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.564504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564507:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714735360:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.564535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714734720:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.564566:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564572:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789050259.564580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714733952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050259.564602:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714735232:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.564626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.564647:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789050259.564653:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714734080:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.564681:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.564729:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714734592:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564781:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714734464:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564797:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564810:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714734976:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564845:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714735488:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.564862:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.564903:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733696 00000100:00100000:2.0:1789050259.564910:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733696 00000100:00100000:2.0:1789050259.564983:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733824 00000100:00100000:2.0:1789050259.564986:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733824 00000100:00100000:2.0:1789050259.565000:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714733952 00000100:00100000:2.0:1789050259.565002:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714733952 00000100:00100000:2.0:1789050259.565015:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050259.565022:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714733696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050259.565047:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789050259.565085:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714733696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.565092:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050259.565108:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050259.565113:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714733824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050259.565128:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789050259.565152:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714733824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.565158:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050259.565169:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050259.565175:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714733952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050259.565184:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789050259.565215:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714733952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050259.565220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.565238:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050259.565238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714735104:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.565261:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734336 00000100:00100000:2.0:1789050259.565266:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734336 00000100:00100000:1.0:1789050259.565279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.565289:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734848 00000100:00100000:2.0:1789050259.565293:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734848 00000100:00100000:1.0:1789050259.565298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714735616:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.565306:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734464 00000100:00100000:2.0:1789050259.565309:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734464 00000100:00100000:2.0:1789050259.565322:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734976 00000100:00100000:2.0:1789050259.565324:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734976 00000100:00100000:1.0:1789050259.565330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050259.565344:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050259.565352:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.565368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714733824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050259.565464:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734208 00000100:00100000:1.0:1789050259.565469:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734208 00000100:00100000:1.0:1789050259.565506:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734720 00000100:00100000:2.0:1789050259.565507:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714734336:12345-0@lo:400:kworker.0 Request processed in 154us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050259.565510:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734720 00000100:00100000:2.0:1789050259.565518:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050259.565534:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789050259.565539:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050259.565544:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714734208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.565551:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050259.566257:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050259.566271:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714734464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050259.566293:0:19123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050259.566303:0:19123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714734976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.567241:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714734848:12345-0@lo:400:kworker.0 Request processed in 1630us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.567252:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050259.567284:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735360 00000100:00100000:2.0:1789050259.567291:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735360 00000100:00100000:2.0:1789050259.567318:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735232 00000100:00100000:2.0:1789050259.567321:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735232 00000100:00100000:2.0:1789050259.567401:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735488 00000100:00100000:2.0:1789050259.567406:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735488 00000100:00100000:2.0:1789050259.567424:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734592 00000100:00100000:2.0:1789050259.567427:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734592 00000100:00100000:2.0:1789050259.567439:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735104 00000100:00100000:2.0:1789050259.567441:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735104 00000100:00100000:2.0:1789050259.567464:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735616 00000100:00100000:2.0:1789050259.567467:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735616 00000100:00100000:2.0:1789050259.567480:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050259.567916:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714735360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568005:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714735360:12345-0@lo:400:kworker.0 Request processed in 518us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568012:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050259.568029:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050259.568036:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714735232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568199:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875954714735232:12345-0@lo:400:kworker.0 Request processed in 163us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568207:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050259.568219:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789050259.568226:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714735488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568255:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875954714735488:12345-0@lo:400:kworker.0 Request processed in 30us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568260:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789050259.568270:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789050259.568276:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714734592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568304:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875954714734592:12345-0@lo:400:kworker.0 Request processed in 28us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568310:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789050259.568321:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789050259.568327:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714735104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568365:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714735104:12345-0@lo:400:kworker.0 Request processed in 39us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568378:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789050259.568390:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789050259.568395:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714735616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568424:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714735616:12345-0@lo:400:kworker.0 Request processed in 29us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568430:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789050259.568454:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714734080 00000100:00100000:2.0:1789050259.568459:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714734080 00000100:00100000:2.0:1789050259.568504:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789050259.568510:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3647:x1875954714734080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568539:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3647:x1875954714734080:12345-0@lo:400:kworker.0 Request processed in 30us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.568545:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789050259.568578:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050259.568581:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789050259.568583:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050259.568586:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050259.568642:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714733952:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789050259.568656:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c4f100 x1875954714735488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875954714735488:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568676:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714734336:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568685:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714734848:0@lo:400:kworker.0 00010000:00080000:2.0:1789050259.568695:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c4ed80 x1875954714735360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714735360:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.568730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714733696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050259.568772:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714734080:0@lo:400:kworker.0 00010000:00080000:2.0:1789050259.568783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa8570aa00 x1875954714734592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568791:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875954714734592:0@lo:400:kworker.0 00010000:00080000:2.0:1789050259.568800:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a3800 x1875954714735104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714735104:0@lo:400:kworker.0 00010000:00080000:2.0:1789050259.568820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c4f800 x1875954714735616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714735616:0@lo:400:kworker.0 00010000:00080000:2.0:1789050259.568838:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab78a2d80 x1875954714735232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050259.568845:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875954714735232:0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.573569:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789050259.573594:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714734720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050259.573700:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714734720:12345-0@lo:400:kworker.0 Request processed in 117us (9134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.573708:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789050259.573789:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714734720:0@lo:400:kworker.0 00000100:00100000:1.0:1789050259.574576:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714734208:12345-0@lo:400:kworker.0 Request processed in 8961us (9999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050259.574588:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789050259.578258:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714734208:0@lo:400:kworker.0 00000100:00100000:3.0:1789050259.584988:0:19123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1875954714734976:12345-0@lo:400:kworker.0 Request processed in 18671us (20137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050259.585005:0:19123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050259.585639:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab78a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714734976:0@lo:400:kworker.0 00000100:00100000:0.0:1789050259.585666:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714734464:12345-0@lo:400:kworker.0 Request processed in 19397us (20864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050259.585673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714734464:0@lo:400:kworker.0 00000100:00100000:0.0:1789050259.585680:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:02000400:3.0:1789050259.679789:0:19868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789050260.329553:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050260.585438:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714735744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050260.585507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050260.585613:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735744 00000100:00100000:2.0:1789050260.585621:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735744 00000100:00100000:2.0:1789050260.585673:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050260.585682:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714735744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050260.585703:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789050260.585747:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714735744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050260.585754:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050260.585792:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714735744:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1789050260.594922:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:3.0:1789050260.596399:0:19920:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789050260.596639:0:19920:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1789050260.779462:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789050261.101951:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050261.101982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714735872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789050261.102078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050261.103052:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714735872 00000100:00100000:3.0:1789050261.103079:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714735872 00000100:00100000:3.0:1789050261.103308:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789050261.103321:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714735872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050261.103523:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050261.103611:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714735872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 292us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050261.103619:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050261.103708:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714735872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050261.104290:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050261.104304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714736000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050261.104349:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050261.106299:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736000 00000100:00100000:0.0:1789050261.106315:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736000 00000100:00100000:0.0:1789050261.106391:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789050261.106402:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714736000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050261.106450:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050261.106544:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714736000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050261.106552:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789050261.106610:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714736000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789050261.354265:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789050261.662540:0:19970:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789050261.662879:0:19970:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789050262.002985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.003343:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172928 00000100:00100000:2.0:1789050262.003358:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172928 00000100:00100000:2.0:1789050262.003413:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789050262.003424:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2402:x1875954704172928:12345-192.168.203.42@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789050262.003462:0:17185:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5fdf6249-ae65-4ba9-86f7-1bba4403ff26@192.168.203.42@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1789050262.003502:0:17185:0:(genops.c:1384:class_connect()) connect: client 5fdf6249-ae65-4ba9-86f7-1bba4403ff26, cookie 0x3b8ec5973df5899b 00000100:00080000:2.0:1789050262.003711:0:17185:0:(import.c:65:import_set_state_nolock()) ffff8ba982773800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050262.003815:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+5:2402:x1875954704172928:12345-192.168.203.42@tcp:250:mount.lustre.0 Request processed in 383us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.003844:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789050262.026195:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.026301:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173056 00000100:00100000:0.0:1789050262.026314:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173056 00000100:00100000:0.0:1789050262.026384:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:0.0:1789050262.026395:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+5:14917:x1875954704173056:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050262.026418:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050262.026441:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df589a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e50 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.026488:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df589a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e50 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.026501:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d7a00/0x3b8ec5973df589a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e50 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.026511:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7a00, rc 0) 00000100:00100000:0.0:1789050262.026588:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+6:14917:x1875954704173056:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 195us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.026614:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:3.0:1789050262.033990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.034203:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173184 00000100:00100000:0.0:1789050262.034218:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173184 00000100:00100000:0.0:1789050262.034294:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:0.0:1789050262.034307:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+6:14917:x1875954704173184:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789050262.034484:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+6:14917:x1875954704173184:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 178us (508us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050262.034492:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:3.0:1789050262.039158:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.039346:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173312 00000100:00100000:2.0:1789050262.039358:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173312 00000100:00100000:2.0:1789050262.039435:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:2.0:1789050262.039448:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+6:14917:x1875954704173312:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050262.039472:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050262.039497:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177200/0x3b8ec5973df589a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e57 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050262.039546:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177200/0x3b8ec5973df589a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e57 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050262.039559:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177200/0x3b8ec5973df589a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e57 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050262.039570:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177200, rc 0) 00000100:00100000:2.0:1789050262.039644:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+7:14917:x1875954704173312:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 199us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.039652:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:1.0:1789050262.044509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.044743:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173440 00000100:00100000:2.0:1789050262.044757:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173440 00000100:00100000:2.0:1789050262.044843:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:2.0:1789050262.044855:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+7:14917:x1875954704173440:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050262.045130:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14917:x1875954704173440:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 276us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.045152:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:3.0:1789050262.047433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.047807:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173568 00000100:00100000:0.0:1789050262.047820:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173568 00000100:00100000:0.0:1789050262.047900:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:0.0:1789050262.047911:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14917:x1875954704173568:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050262.048145:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14917:x1875954704173568:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 235us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.048154:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:3.0:1789050262.052549:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.053668:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173696 00000100:00100000:0.0:1789050262.053684:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173696 00000100:00100000:0.0:1789050262.053765:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:0.0:1789050262.053778:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173696:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050262.054033:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173696:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 257us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.054041:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:3.0:1789050262.093340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.104198:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173824 00000100:00100000:2.0:1789050262.104220:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173824 00000100:00100000:2.0:1789050262.104367:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:2.0:1789050262.104381:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173824:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050262.104611:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173824:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 232us (11285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.104620:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:3.0:1789050262.121315:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.121831:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173952 00000100:00100000:0.0:1789050262.121846:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173952 00000100:00100000:0.0:1789050262.121989:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:0.0:1789050262.122003:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173952:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050262.122202:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14937:x1875954704173952:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 202us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.122212:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:3.0:1789050262.135261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.135388:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174080 00000100:00100000:0.0:1789050262.135401:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174080 00000100:00100000:0.0:1789050262.135472:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:0.0:1789050262.135483:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+8:14917:x1875954704174080:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050262.135504:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050262.135526:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d7000/0x3b8ec5973df589b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e88 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.135563:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7000/0x3b8ec5973df589b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e88 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.135577:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d7000/0x3b8ec5973df589b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e88 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050262.135598:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7000, rc 0) 00000100:00100000:0.0:1789050262.135671:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+9:14917:x1875954704174080:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 189us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.135678:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:3.0:1789050262.146103:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.146387:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174208 00000100:00100000:2.0:1789050262.146402:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174208 00000100:00100000:2.0:1789050262.146476:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:2.0:1789050262.146489:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+9:14917:x1875954704174208:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789050262.146523:0:17187:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789050262.146558:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789050262.146563:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789050262.146566:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789050262.146569:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789050262.146572:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789050262.149772:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+9:14917:x1875954704174208:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 3270us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.149791:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:3.0:1789050262.164214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050262.167955:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174336 00000100:00100000:1.0:1789050262.167977:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174336 00000100:00100000:1.0:1789050262.168070:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:1.0:1789050262.168083:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+9:14917:x1875954704174336:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789050262.168105:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050262.168129:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966e8f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.168165:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.168177:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.168188:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0000, rc 0) 00000100:00100000:1.0:1789050262.168285:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14917:x1875954704174336:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 204us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050262.168293:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:3.0:1789050262.174214:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.174428:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174464 00000100:00100000:2.0:1789050262.174442:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174464 00000100:00100000:2.0:1789050262.174518:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 127 00000100:00100000:2.0:1789050262.174529:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14917:x1875954704174464:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050262.174760:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14917:x1875954704174464:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 233us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.174769:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 127 00000100:00100000:2.0:1789050262.182908:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.183088:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174592 00000100:00100000:0.0:1789050262.183102:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174592 00000100:00100000:0.0:1789050262.183176:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:0.0:1789050262.183189:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14917:x1875954704174592:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050262.183405:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa82e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14917:x1875954704174592:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 218us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.183414:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:3.0:1789050262.187621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.188026:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174720 00000100:00100000:0.0:1789050262.188040:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174720 00000100:00100000:0.0:1789050262.188127:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:0.0:1789050262.188139:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14940:x1875954704174720:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050262.188355:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14940:x1875954704174720:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 212us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.188363:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:3.0:1789050262.193551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.194999:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174848 00000100:00100000:2.0:1789050262.195020:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174848 00000100:00100000:2.0:1789050262.195122:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:2.0:1789050262.195134:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14940:x1875954704174848:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050262.195449:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:14940:x1875954704174848:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 315us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.195458:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:3.0:1789050262.212183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050262.212299:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.212447:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174976 00000100:00100000:0.0:1789050262.212460:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174976 00000100:00100000:0.0:1789050262.212518:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175232 00000100:00100000:0.0:1789050262.212521:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175232 00000100:00100000:2.0:1789050262.212557:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789050262.212571:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875954704174976:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789050262.212621:0:17194:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 401f46b2-7a10-4bef-9b8f-516c59334602@192.168.203.42@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1789050262.212698:0:17194:0:(genops.c:1384:class_connect()) connect: client 401f46b2-7a10-4bef-9b8f-516c59334602, cookie 0x3b8ec5973df589be 00000004:00100000:2.0:1789050262.212733:0:17194:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789050262.213092:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8ba982770800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050262.213191:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2402:x1875954704174976:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 620us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.213200:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789050262.213224:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789050262.213230:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875954704175232:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789050262.213249:0:17194:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 401f46b2-7a10-4bef-9b8f-516c59334602@192.168.203.42@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1789050262.213290:0:17194:0:(genops.c:1384:class_connect()) connect: client 401f46b2-7a10-4bef-9b8f-516c59334602, cookie 0x3b8ec5973df589c5 00000004:00100000:2.0:1789050262.213323:0:17194:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789050262.213478:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8ba982772800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050262.213505:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2402:x1875954704175232:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 274us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.213514:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:3.0:1789050262.242507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.243726:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175360 00000100:00100000:0.0:1789050262.243743:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175360 00000100:00100000:0.0:1789050262.243855:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789050262.243869:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:0:x1875954704175360:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050262.243930:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050262.244092:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:0:x1875954704175360:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 227us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.244101:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00080000:2.0:1789050262.244236:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789050262.277559:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050262.277606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050262.277760:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175104 00000100:00100000:2.0:1789050262.277774:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175104 00000100:00100000:2.0:1789050262.277860:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175488 00000100:00100000:2.0:1789050262.277863:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175488 00000100:00100000:2.0:1789050262.277880:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789050262.277890:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+7:0:x1875954704175104:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789050262.278007:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789050262.278104:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+7:0:x1875954704175104:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 215us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.278113:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789050262.278130:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789050262.278138:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704175488:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789050262.278149:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789050262.278170:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704175488:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050262.278176:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00080000:0.0:1789050262.279655:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050262.288425:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050262.292015:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175616 00000100:00100000:3.0:1789050262.292038:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175616 00000100:00100000:3.0:1789050262.292142:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:3.0:1789050262.292154:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704175616:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789050262.292289:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704175616:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 137us (3878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050262.292297:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:3.0:1789050262.296268:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050262.296325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050262.296413:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050262.296534:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175744 00000100:00100000:2.0:1789050262.296535:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175872 00000100:00100000:2.0:1789050262.296549:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175872 00000100:00100000:1.0:1789050262.296549:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175744 00000100:00100000:0.0:1789050262.296643:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176000 00000100:00100000:0.0:1789050262.296663:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176000 00000100:00100000:0.0:1789050262.296726:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789050262.296737:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704176000:12345-192.168.203.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789050262.296837:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704176000:12345-192.168.203.42@tcp:900:mount.lustre.0 Request processed in 101us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050262.296845:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:1.0:1789050262.297325:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789050262.297333:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1875954704175744:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789050262.297367:0:18699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 401f46b2-7a10-4bef-9b8f-516c59334602@192.168.203.42@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1789050262.297405:0:18699:0:(genops.c:1384:class_connect()) connect: client 401f46b2-7a10-4bef-9b8f-516c59334602, cookie 0x3b8ec5973df589cc 00002000:00100000:1.0:1789050262.297422:0:18699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 401f46b2-7a10-4bef-9b8f-516c59334602/ffff8ba982646800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789050262.297447:0:18699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789050262.297705:0:18699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789050262.297744:0:18699:0:(import.c:65:import_set_state_nolock()) ffff8ba982640800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050262.297804:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:2402:x1875954704175744:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 469us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050262.297812:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789050262.297832:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789050262.297837:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1875954704175872:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789050262.297855:0:18699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 401f46b2-7a10-4bef-9b8f-516c59334602@192.168.203.42@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1789050262.297873:0:18699:0:(genops.c:1384:class_connect()) connect: client 401f46b2-7a10-4bef-9b8f-516c59334602, cookie 0x3b8ec5973df589d3 00002000:00100000:1.0:1789050262.297879:0:18699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 401f46b2-7a10-4bef-9b8f-516c59334602/ffff8ba982645800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789050262.297892:0:18699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789050262.298058:0:18699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789050262.298075:0:18699:0:(import.c:65:import_set_state_nolock()) ffff8ba982640000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050262.298101:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:2402:x1875954704175872:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 262us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050262.298107:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:3.0:1789050262.305241:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050262.307022:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176128 00000100:00100000:1.0:1789050262.307045:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176128 00000100:00100000:1.0:1789050262.307126:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789050262.307138:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704176128:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789050262.311259:0:17196:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3999us 00000004:00200000:3.0:1789050262.319811:0:17196:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789050262.320035:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:14917:x1875954704176128:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 12889us (14800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050262.320549:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00010000:00010000:0.0:1789050262.377284:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050262.587401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050262.587526:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176256 00000100:00100000:1.0:1789050262.587540:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176256 00000100:00100000:1.0:1789050262.587619:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:1.0:1789050262.587632:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:14963:x1875954704176256:12345-192.168.203.42@tcp:101:mkdir.0 00010000:00010000:1.0:1789050262.587679:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050262.587714:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df589da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ec0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.587802:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.587821:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.587840:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050262.587902:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789050262.587907:0:17194:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050262.588016:0:17194:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.588115:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df589da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ec0 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.588140:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ec0 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050262.588149:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:1.0:1789050262.588152:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050262.588156:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0600, rc 0) 00000100:00100000:1.0:1789050262.588236:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+7:14963:x1875954704176256:12345-192.168.203.42@tcp:101:mkdir.0 Request processed in 607us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050262.588245:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000040:00080000:0.0:1789050263.018845:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789050263.401494:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050264.425453:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050264.565178:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.568646:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176384 00000100:00100000:3.0:1789050264.568665:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176384 00000100:00100000:3.0:1789050264.568829:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789050264.568841:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+7:15015:x1875954704176384:12345-192.168.203.42@tcp:41:lfs.0 00000004:00000024:3.0:1789050264.568886:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050264.570641:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+7:15015:x1875954704176384:12345-192.168.203.42@tcp:41:lfs.0 Request processed in 1792us (6343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.570657:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789050264.575343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.575456:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176512 00000100:00100000:2.0:1789050264.575469:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176512 00000100:00080000:0.0:1789050264.576735:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050264.576743:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050264.579527:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789050264.579551:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176512:12345-192.168.203.42@tcp:41:lfs.0 00000004:00000024:2.0:1789050264.579610:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789050264.579750:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176512:12345-192.168.203.42@tcp:41:lfs.0 Request processed in 209us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.579759:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789050264.590526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.591127:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176640 00000100:00100000:2.0:1789050264.591142:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176640 00000100:00100000:2.0:1789050264.591237:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789050264.591250:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176640:12345-192.168.203.42@tcp:13:lfs.0 00002000:00000024:2.0:1789050264.591309:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1789050264.591545:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050264.592664:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176640:12345-192.168.203.42@tcp:13:lfs.0 Request processed in 1404us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.592678:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789050264.615428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050264.616690:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176768 00000100:00100000:1.0:1789050264.616711:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176768 00000100:00100000:1.0:1789050264.616817:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789050264.616831:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176768:12345-192.168.203.42@tcp:13:lfs.0 00002000:00000024:1.0:1789050264.616879:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1789050264.617231:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050264.617458:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:401f46b2-7a10-4bef-9b8f-516c59334602+6:15015:x1875954704176768:12345-192.168.203.42@tcp:13:lfs.0 Request processed in 628us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050264.617472:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789050264.681892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050264.684894:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714736512:0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.685053:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.685133:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050264.685141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714736384:0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.685177:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.685222:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736512 00000100:00100000:0.0:1789050264.685231:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736512 00000100:00100000:0.0:1789050264.685291:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789050264.685316:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714736512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.685382:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714736512:12345-0@lo:400:kworker.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.685390:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789050264.685462:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714736512:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.692581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.692813:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050264.692913:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736384 00000100:00100000:3.0:1789050264.692926:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736384 00000100:00100000:3.0:1789050264.693164:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789050264.693174:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3645:x1875954714736384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.693241:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3645:x1875954714736384:12345-0@lo:400:kworker.0 Request processed in 68us (8062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.693249:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789050264.693554:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736640 00000100:00100000:0.0:1789050264.693561:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736640 00000100:00100000:0.0:1789050264.693729:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050264.693738:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714736640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.693791:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714736640:12345-0@lo:400:kworker.0 Request processed in 56us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.693798:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050264.693852:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714736640:0@lo:400:kworker.0 00000100:00080000:0.0:1789050264.693880:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050264.693913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9e852cd-105e-4a2b-8f2f-088fc33df062:3645:1875954714736384:0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.694101:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714736256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050264.694143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.694172:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714736768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050264.694193:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.694219:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714736128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050264.694239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.694286:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736256 00000100:00100000:0.0:1789050264.694292:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736256 00000100:00100000:3.0:1789050264.694709:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736768 00000100:00100000:3.0:1789050264.694714:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736768 00000100:00100000:3.0:1789050264.694753:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736128 00000100:00100000:3.0:1789050264.694756:0:18703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736128 00000100:00100000:3.0:1789050264.694772:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050264.694780:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714736768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050264.694802:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789050264.694853:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714736768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.694860:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050264.694875:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050264.694882:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714736128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050264.694894:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789050264.694951:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714736128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.694958:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789050264.698857:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050264.698951:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789050264.699012:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714736768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050264.699047:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714736128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050264.700589:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714737152:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.700699:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050264.700770:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737152 00000100:00100000:2.0:1789050264.700780:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737152 00000100:00100000:2.0:1789050264.700848:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050264.700857:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714737152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.700927:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714737152:12345-0@lo:400:kworker.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.700935:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050264.701234:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714737152:0@lo:400:kworker.0 00000100:00080000:2.0:1789050264.701262:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050264.701565:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714736896:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.701618:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050264.701646:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050264.701651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714737024:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.701675:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050264.701712:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737024 00000100:00100000:3.0:1789050264.701717:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737024 00000100:00100000:3.0:1789050264.701753:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789050264.701760:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714737024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.701821:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714737024:12345-0@lo:400:kworker.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.701827:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789050264.701853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714737024:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.701873:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714736896 00000100:00100000:3.0:1789050264.701877:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714736896 00000100:00100000:3.0:1789050264.701915:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789050264.701922:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714736896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.702423:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875954714736896:12345-0@lo:400:kworker.0 Request processed in 500us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.702432:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789050264.702466:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875954714736896:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.702755:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050264.702767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714737280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.702799:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050264.702828:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737280 00000100:00100000:2.0:1789050264.702833:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737280 00000100:00100000:2.0:1789050264.702861:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789050264.702867:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714737280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.702914:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714737280:12345-0@lo:400:kworker.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.702919:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050264.703193:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714737408:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.703222:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050264.703252:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737408 00000100:00100000:3.0:1789050264.703256:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737408 00000100:00100000:3.0:1789050264.703290:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050264.707388:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714737408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.707552:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875954714737408:12345-0@lo:400:kworker.0 Request processed in 4253us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.707567:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789050264.707778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714737280:0@lo:400:kworker.0 00000100:00080000:2.0:1789050264.707837:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050264.708715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714737664:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.708788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050264.708854:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737664 00000100:00100000:2.0:1789050264.708864:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737664 00000100:00100000:3.0:1789050264.709377:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050264.709410:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714737664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.709481:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875954714737664:12345-0@lo:400:kworker.0 Request processed in 75us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.709490:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050264.709563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875954714737408:0@lo:400:kworker.0 00000100:00100000:3.0:1789050264.709583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050264.709592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714737536:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.710158:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875954714737664:0@lo:400:kworker.0 00000100:00080000:2.0:1789050264.710187:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050264.710236:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050264.710242:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714737792:0@lo:400:kworker.0 00000100:00100000:2.0:1789050264.710283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050264.710480:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737792 00000100:00100000:1.0:1789050264.710489:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737792 00000100:00100000:1.0:1789050264.710537:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050264.710546:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714737792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050264.711853:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050264.711878:0:18703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714736256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050264.711916:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789050264.715447:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714737792:12345-0@lo:400:kworker.0 Request processed in 4885us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050264.715469:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789050264.718893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d9bb80 x1875954714737792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050264.718929:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714737792:0@lo:400:kworker.0 00000100:00080000:2.0:1789050264.719012:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050264.719866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.723273:0:18703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714736256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11393us (29115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.723292:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050264.723712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714736256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050264.725163:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737536 00000100:00100000:1.0:1789050264.725181:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737536 00000100:00100000:1.0:1789050264.725338:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050264.725350:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714737536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050264.725465:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714737536:12345-0@lo:400:kworker.0 Request processed in 117us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050264.725494:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789050264.725729:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983d99f80 x1875954714737536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050264.725746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714737536:0@lo:400:kworker.0 00000100:00080000:3.0:1789050264.729702:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050264.792052:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.792192:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176896 00000100:00100000:0.0:1789050264.792214:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176896 00000100:00100000:0.0:1789050264.792289:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:0.0:1789050264.792301:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+10:15048:x1875954704176896:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050264.792333:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050264.792368:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d6800/0x3b8ec5973df589e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ec7 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.792409:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d6800/0x3b8ec5973df589e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ec7 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.792424:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d6800/0x3b8ec5973df589e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ec7 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.792436:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6800, rc 0) 00000100:00100000:0.0:1789050264.792522:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704176896:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 222us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.792529:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:0.0:1789050264.798131:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.798436:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177024 00000100:00100000:3.0:1789050264.798450:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177024 00000100:00100000:3.0:1789050264.798523:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:3.0:1789050264.798535:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704177024:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789050264.798794:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704177024:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 260us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.798804:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:2.0:1789050264.807666:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.807800:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177152 00000100:00100000:3.0:1789050264.807816:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177152 00000100:00100000:3.0:1789050264.807893:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:3.0:1789050264.807917:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704177152:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789050264.808592:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704177152:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 686us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.808602:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:3.0:1789050264.813254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.814170:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177280 00000100:00100000:0.0:1789050264.814185:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177280 00000100:00100000:0.0:1789050264.814508:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00100000:0.0:1789050264.814522:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177280:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050264.814736:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177280:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 217us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.814745:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00100000:0.0:1789050264.851373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.852373:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177408 00000100:00100000:3.0:1789050264.852390:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177408 00000100:00100000:3.0:1789050264.852475:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:3.0:1789050264.852488:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177408:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050264.852697:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177408:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 211us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.852706:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:3.0:1789050264.875665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.880005:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177536 00000100:00100000:2.0:1789050264.880022:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177536 00000100:00100000:2.0:1789050264.880101:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:2.0:1789050264.880111:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177536:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050264.880279:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15054:x1875954704177536:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 168us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.880287:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:1.0:1789050264.885415:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.885799:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177664 00000100:00100000:0.0:1789050264.885813:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177664 00000100:00100000:0.0:1789050264.886016:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00100000:0.0:1789050264.886029:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:15048:x1875954704177664:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050264.886051:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050264.886075:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df589ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ef8 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.886114:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df589ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ef8 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.886129:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d7c00/0x3b8ec5973df589ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ef8 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.886139:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d7c00, rc 0) 00000100:00100000:0.0:1789050264.886233:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:15048:x1875954704177664:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 206us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.886241:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00100000:0.0:1789050264.896392:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.900876:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177792 00000100:00100000:2.0:1789050264.900909:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177792 00000100:00100000:3.0:1789050264.901433:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:3.0:1789050264.901449:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:15048:x1875954704177792:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789050264.901484:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789050264.901521:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789050264.901525:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789050264.901529:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789050264.901532:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789050264.901534:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789050264.907758:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:15048:x1875954704177792:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 6296us (11363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.907780:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:1.0:1789050264.913844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.913990:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177920 00000100:00100000:0.0:1789050264.914012:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177920 00000100:00100000:0.0:1789050264.914086:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:0.0:1789050264.914098:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:15048:x1875954704177920:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050264.914119:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050264.914141:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966eff expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.914178:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.914210:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050264.914221:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6600, rc 0) 00000100:00100000:0.0:1789050264.914298:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15048:x1875954704177920:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 201us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.914306:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:0.0:1789050264.916713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.916811:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178048 00000100:00100000:3.0:1789050264.916824:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178048 00000100:00100000:3.0:1789050264.916976:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789050264.916989:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15048:x1875954704178048:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789050264.917212:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15048:x1875954704178048:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 225us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.917237:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789050264.922889:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.923484:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178176 00000100:00100000:0.0:1789050264.923501:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178176 00000100:00100000:0.0:1789050264.923644:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:0.0:1789050264.923657:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15048:x1875954704178176:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050264.923858:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9835be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15048:x1875954704178176:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 203us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.923867:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:1.0:1789050264.931226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.937582:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178304 00000100:00100000:2.0:1789050264.937606:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178304 00000100:00100000:2.0:1789050264.937696:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:2.0:1789050264.937709:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15057:x1875954704178304:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050264.937955:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15057:x1875954704178304:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 248us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.937964:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:0.0:1789050264.941897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.942040:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178432 00000100:00100000:3.0:1789050264.942052:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178432 00000100:00100000:1.0:1789050264.942116:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:1.0:1789050264.942147:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15057:x1875954704178432:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050264.942671:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:15057:x1875954704178432:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 535us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050264.942682:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:1.0:1789050264.956304:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050264.956456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.956897:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178560 00000100:00100000:3.0:1789050264.956922:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178560 00000100:00100000:3.0:1789050264.957008:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178816 00000100:00100000:3.0:1789050264.957012:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178816 00000100:00100000:3.0:1789050264.957040:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:3.0:1789050264.957050:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875954704178560:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789050264.957091:0:17192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ecbb0205-dfd3-498a-b75f-85e633519280@192.168.203.42@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789050264.957145:0:17192:0:(genops.c:1384:class_connect()) connect: client ecbb0205-dfd3-498a-b75f-85e633519280, cookie 0x3b8ec5973df589fd 00000004:00100000:3.0:1789050264.957178:0:17192:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789050264.957350:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8baaa737a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050264.957449:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:2402:x1875954704178560:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 398us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.957458:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:3.0:1789050264.957481:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789050264.957486:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875954704178816:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789050264.957503:0:17192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ecbb0205-dfd3-498a-b75f-85e633519280@192.168.203.42@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789050264.957527:0:17192:0:(genops.c:1384:class_connect()) connect: client ecbb0205-dfd3-498a-b75f-85e633519280, cookie 0x3b8ec5973df58a04 00000004:00100000:3.0:1789050264.957542:0:17192:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789050264.957595:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8baaa737f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050264.957622:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:2402:x1875954704178816:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 134us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.957640:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789050264.976388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.976441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050264.976475:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.976562:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179072 00000100:00100000:2.0:1789050264.976576:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179072 00000100:00100000:0.0:1789050264.976625:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178944 00000100:00100000:0.0:1789050264.976631:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178944 00000100:00100000:2.0:1789050264.976663:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178688 00000100:00100000:2.0:1789050264.976669:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178688 00000100:00100000:0.0:1789050264.976675:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050264.976691:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+7:15048:x1875954704179072:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050264.976745:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789050264.976849:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+7:15048:x1875954704179072:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 162us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.976858:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050264.976882:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050264.976921:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:0:x1875954704178944:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050264.976977:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050264.977009:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:0:x1875954704178944:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 89us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.977015:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050264.977031:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050264.977037:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:0:x1875954704178688:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050264.977049:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789050264.977073:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:0:x1875954704178688:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.977080:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00080000:3.0:1789050264.977203:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789050264.977208:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050264.990301:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.990582:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179200 00000100:00100000:2.0:1789050264.990597:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179200 00000100:00100000:2.0:1789050264.990673:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789050264.990685:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179200:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789050264.990817:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179200:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050264.990826:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789050264.995473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050264.995528:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050264.995673:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179584 00000100:00100000:0.0:1789050264.995692:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179584 00000100:00100000:0.0:1789050264.995773:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789050264.995785:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179584:12345-192.168.203.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789050264.995909:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179584:12345-192.168.203.42@tcp:900:mount.lustre.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.995919:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:3.0:1789050264.996435:0:19123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179328 00000100:00100000:3.0:1789050264.996442:0:19123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179328 00000100:00100000:3.0:1789050264.996480:0:19123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789050264.996486:0:19123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875954704179328:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789050264.996521:0:19123:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ecbb0205-dfd3-498a-b75f-85e633519280@192.168.203.42@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789050264.996563:0:19123:0:(genops.c:1384:class_connect()) connect: client ecbb0205-dfd3-498a-b75f-85e633519280, cookie 0x3b8ec5973df58a0b 00002000:00100000:3.0:1789050264.996579:0:19123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ecbb0205-dfd3-498a-b75f-85e633519280/ffff8baaa737a000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789050264.996594:0:19123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789050264.996719:0:19123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789050264.996757:0:19123:0:(import.c:65:import_set_state_nolock()) ffff8baaa737c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050264.996809:0:19123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ecbb0205-dfd3-498a-b75f-85e633519280+6:2402:x1875954704179328:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 321us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050264.996817:0:19123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789050265.002136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050265.002250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050265.002368:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179456 00000100:00100000:0.0:1789050265.002384:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179456 00000100:00100000:0.0:1789050265.002449:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050265.002460:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875954704179456:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050265.002508:0:18698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ecbb0205-dfd3-498a-b75f-85e633519280@192.168.203.42@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1789050265.002550:0:18698:0:(genops.c:1384:class_connect()) connect: client ecbb0205-dfd3-498a-b75f-85e633519280, cookie 0x3b8ec5973df58a12 00002000:00100000:0.0:1789050265.002591:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ecbb0205-dfd3-498a-b75f-85e633519280/ffff8baab7f57000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050265.002607:0:18698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789050265.002844:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789050265.002886:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8baab7f54000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050265.003012:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:2402:x1875954704179456:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 552us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.003022:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:3.0:1789050265.004067:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179712 00000100:00100000:3.0:1789050265.004078:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179712 00000100:00100000:3.0:1789050265.004136:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:3.0:1789050265.004146:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179712:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789050265.004261:0:17195:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789050265.004347:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:15048:x1875954704179712:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 202us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050265.004368:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:0.0:1789050265.256435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050265.256552:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179840 00000100:00100000:1.0:1789050265.256569:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179840 00000100:00100000:1.0:1789050265.256648:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:1.0:1789050265.256658:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:15080:x1875954704179840:12345-192.168.203.42@tcp:101:mkdir.0 00010000:00010000:1.0:1789050265.256679:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050265.256699:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df58a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f30 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.256798:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.256815:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.256829:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050265.256875:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789050265.256879:0:17192:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050265.256912:0:17192:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.256988:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0e00/0x3b8ec5973df58a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.257013:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.257021:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:1.0:1789050265.257023:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050265.257026:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0400, rc 0) 00000100:00100000:1.0:1789050265.257099:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+7:15080:x1875954704179840:12345-192.168.203.42@tcp:101:mkdir.0 Request processed in 442us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050265.257106:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00010000:00010000:0.0:1789050265.450200:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050265.705168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714737920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050265.705235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050265.705360:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714737920 00000100:00100000:2.0:1789050265.705368:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714737920 00000100:00100000:2.0:1789050265.705422:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050265.705432:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714737920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789050265.705454:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789050265.705500:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714737920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050265.705507:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050265.705559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714737920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789050266.218733:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050266.218763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714738048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050266.218854:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050266.219194:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738048 00000100:00100000:0.0:1789050266.219205:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738048 00000100:00100000:0.0:1789050266.219266:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789050266.219277:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714738048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050266.219328:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050266.219389:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714738048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.219396:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789050266.219450:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714738048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789050266.222032:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714738176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789050266.222132:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050266.222610:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738176 00000100:00100000:0.0:1789050266.222622:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738176 00000100:00100000:0.0:1789050266.222681:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050266.222692:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714738176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789050266.222738:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789050266.222799:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714738176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.222806:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050266.222877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714738176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789050266.475586:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050267.497449:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789050267.761405:0:18695:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ecbb0205-dfd3-498a-b75f-85e633519280 00000001:00100000:3.0:1789050267.761426:0:18695:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 401f46b2-7a10-4bef-9b8f-516c59334602 00000001:00100000:3.0:1789050267.762457:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ecbb0205-dfd3-498a-b75f-85e633519280 00000001:00100000:3.0:1789050267.762471:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 401f46b2-7a10-4bef-9b8f-516c59334602 00000001:00100000:2.0:1789050267.763512:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ecbb0205-dfd3-498a-b75f-85e633519280 00000001:00100000:2.0:1789050267.763524:0:19512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 401f46b2-7a10-4bef-9b8f-516c59334602 00000001:00100000:0.0:1789050267.763929:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ecbb0205-dfd3-498a-b75f-85e633519280 00000001:00100000:0.0:1789050267.763977:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 401f46b2-7a10-4bef-9b8f-516c59334602 00010000:00010000:0.0:1789050268.524078:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789050269.182465:0:20068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789050269.545154:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050269.801792:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050269.801815:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714738432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050269.801898:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050269.802223:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050269.802235:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714738304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050269.802267:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050269.802313:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738432 00000100:00100000:2.0:1789050269.802320:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738432 00000100:00100000:2.0:1789050269.802365:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738304 00000100:00100000:2.0:1789050269.802368:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738304 00000100:00100000:2.0:1789050269.802387:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050269.802412:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714738432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789050269.802454:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789050269.802497:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714738432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050269.802505:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050269.802521:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789050269.802528:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714738304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050269.802544:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789050269.802576:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714738304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050269.802582:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789050269.802601:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050269.802605:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050269.802907:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050269.802918:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714738560:0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.802974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050269.803011:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738560 00000100:00100000:1.0:1789050269.803016:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738560 00000100:00100000:1.0:1789050269.803054:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789050269.803061:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3644:x1875954714738560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.803098:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3644:x1875954714738560:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050269.803105:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789050269.803138:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714738560:0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.803185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714738432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050269.803490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714738304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050269.803572:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050269.803583:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714738688:0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.803616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050269.803670:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738688 00000100:00100000:3.0:1789050269.803674:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738688 00000100:00100000:3.0:1789050269.803702:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050269.803708:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714738688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.803746:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714738688:12345-0@lo:400:kworker.0 Request processed in 37us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050269.803752:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050269.803783:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714738688:0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.804034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050269.804073:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050269.804191:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738816 00000100:00100000:1.0:1789050269.804204:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738816 00000100:00100000:1.0:1789050269.804245:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050269.804251:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714738816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050269.804264:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789050269.804309:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714738816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050269.804315:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789050269.804528:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050269.804554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaa7dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050269.805532:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714739328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.805581:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.805606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714739840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.805811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714739072:0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.805842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050269.805894:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714739584:0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.805962:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739328 00000100:00100000:3.0:1789050269.805969:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739328 00000100:00100000:3.0:1789050269.806010:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050269.806019:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714739328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.806073:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714739328:12345-0@lo:400:kworker.0 Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050269.806081:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789050269.806387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050269.806526:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739840 00000100:00100000:3.0:1789050269.806531:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739840 00000100:00100000:3.0:1789050269.806566:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789050269.806573:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714739840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.806609:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714739840:12345-0@lo:400:kworker.0 Request processed in 37us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050269.806615:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789050269.806643:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050269.806666:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739072 00000100:00100000:3.0:1789050269.806669:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739072 00000100:00100000:3.0:1789050269.806692:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789050269.806699:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714739072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.806730:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714739072:12345-0@lo:400:kworker.0 Request processed in 32us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050269.806736:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789050269.806850:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714739328:0@lo:400:kworker.0 00010000:00080000:0.0:1789050269.806876:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c10a80 x1875954714739840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050269.806888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714739840:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.806908:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789050269.806915:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714739200:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.806970:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.806987:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714739712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807004:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.807026:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739712 00000100:00100000:0.0:1789050269.807029:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739712 00000100:00100000:0.0:1789050269.807133:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789050269.807141:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714739712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807190:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714739712:12345-0@lo:400:kworker.0 Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050269.807210:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789050269.807225:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050269.807237:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.807265:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714739072:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807275:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789050269.807701:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714739712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807854:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714738944:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807899:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.807927:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714739456:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.807969:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050269.807989:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739584 00000100:00100000:0.0:1789050269.807993:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739584 00000100:00100000:0.0:1789050269.808038:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714738944 00000100:00100000:1.0:1789050269.808151:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739456 00000100:00100000:1.0:1789050269.808155:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739456 00000100:00100000:1.0:1789050269.808182:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050269.808190:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714739584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.808248:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714739584:12345-0@lo:400:kworker.0 Request processed in 59us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050269.808261:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050269.808277:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789050269.808296:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714739456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.808327:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714739456:12345-0@lo:400:kworker.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050269.808333:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789050269.808363:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050269.808366:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050269.808389:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714739456:0@lo:400:kworker.0 00010000:00080000:1.0:1789050269.808401:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ba983c10000 x1875954714739584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050269.808412:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714739584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.808701:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714738944 00000100:00100000:0.0:1789050269.808738:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050269.808745:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714738944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050269.808874:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739200 00000100:00100000:3.0:1789050269.808879:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739200 00000100:00100000:3.0:1789050269.808917:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050269.808925:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714739200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050269.809071:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875954714738944:0@lo:400:kworker.0 00000100:00080000:1.0:1789050269.809095:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050269.815659:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875954714739200:12345-0@lo:400:kworker.0 Request processed in 6725us (8678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050269.815675:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050269.815894:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875954714739200:0@lo:400:kworker.0 00000100:00100000:0.0:1789050269.821586:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875954714738944:12345-0@lo:400:kworker.0 Request processed in 12830us (13674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050269.821603:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050270.162681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162915:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.162956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050270.163014:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180224 00000100:00100000:2.0:1789050270.163024:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180224 00000100:00100000:2.0:1789050270.163081:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180736 00000100:00100000:2.0:1789050270.163084:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180736 00000100:00100000:2.0:1789050270.163096:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180096 00000100:00100000:2.0:1789050270.163098:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180096 00000100:00100000:2.0:1789050270.163110:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180608 00000100:00100000:2.0:1789050270.163112:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180608 00000100:00100000:2.0:1789050270.163126:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789050270.163135:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180224:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050270.163206:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180224:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 72us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050270.163214:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789050270.163231:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:2.0:1789050270.163238:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180736:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050270.163278:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180736:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050270.163285:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:2.0:1789050270.163298:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:2.0:1789050270.163305:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2406:x1875954704180096:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050270.163328:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2406:x1875954704180096:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050270.163335:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:2.0:1789050270.163346:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050270.163352:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2406:x1875954704180608:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050270.163376:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2406:x1875954704180608:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050270.163391:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050270.163413:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180480 00000100:00100000:2.0:1789050270.163417:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180480 00000100:00100000:0.0:1789050270.163729:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180992 00000100:00100000:0.0:1789050270.163734:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180992 00000100:00100000:0.0:1789050270.163769:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180352 00000100:00100000:0.0:1789050270.163773:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180352 00000100:00100000:0.0:1789050270.163787:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180864 00000100:00100000:0.0:1789050270.163790:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180864 00000100:00100000:0.0:1789050270.163803:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789050270.163809:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180992:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050270.163845:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180992:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 35us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050270.163852:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789050270.163875:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789050270.163882:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180352:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050270.163906:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab78a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180352:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050270.163912:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789050270.163922:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789050270.163928:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180864:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050270.163968:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2406:x1875954704180864:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050270.163974:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00080000:3.0:1789050270.164394:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050270.164399:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050270.164401:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050270.164403:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789050270.164562:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789050270.164570:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180480:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050270.164606:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:2406:x1875954704180480:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050270.164612:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00080000:3.0:1789050270.164714:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050270.165151:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179968 00000100:00100000:1.0:1789050270.165158:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179968 00000100:00100000:1.0:1789050270.165198:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:1.0:1789050270.165206:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2406:x1875954704179968:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789050270.165253:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2406:x1875954704179968:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 48us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050270.165261:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 146 00010000:00010000:3.0:1789050270.570205:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050270.826302:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714739968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050270.826372:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050270.826628:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714739968 00000100:00100000:3.0:1789050270.826637:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714739968 00000100:00100000:3.0:1789050270.826690:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050270.826699:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714739968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050270.826728:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789050270.826776:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaa7dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714739968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050270.826783:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789050270.827165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714739968:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789050271.019545:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050271.337173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050271.337269:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050271.337325:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740096 00000100:00100000:3.0:1789050271.337333:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740096 00000100:00100000:3.0:1789050271.337379:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050271.337389:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714740096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050271.337429:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050271.337476:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714740096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050271.337483:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050271.337536:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050271.337701:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050271.337724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714740224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050271.337757:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050271.338980:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740224 00000100:00100000:3.0:1789050271.339164:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740224 00000100:00100000:3.0:1789050271.339226:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789050271.339236:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714740224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789050271.339447:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789050271.339526:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714740224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 291us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050271.339533:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789050271.339622:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714740224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789050271.595410:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050272.626087:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789050272.677502:0:20216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd17e6ce90 20000000:00000080:0.0:1789050272.677518:0:20216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8baa83734c00 uarg=0000000000000000 20000000:01000000:0.0:1789050272.677567:0:20216:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789050272.677573:0:20216:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789050272.677577:0:20216:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789050272.678114:0:20217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789050272.678262:0:20216:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789050272.685050:0:20216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789050272.685184:0:20216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685203:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685211:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685219:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685225:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685235:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685241:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685248:0:20216:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685869:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.685888:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 12 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.685903:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740352:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050272.686267:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.686288:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.686299:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740480:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050272.686332:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.686340:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 23 pid: 17187 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.686347:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740608:0@lo:104: 00000100:00100000:0.0:1789050272.686383:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050272.686423:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.686430:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 23 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.686438:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740736:0@lo:104: 00000100:00100000:0.0:1789050272.686456:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050272.686477:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.686484:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 23 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.686491:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740864:0@lo:104: 00000100:00100000:0.0:1789050272.686517:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050272.686532:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.686540:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 23 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.686546:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740992:0@lo:104: 00000100:00100000:0.0:1789050272.686566:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050272.686575:0:20216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050272.687256:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740608 00000100:00100000:2.0:1789050272.687265:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740608 00000100:00100000:2.0:1789050272.687301:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740736 00000100:00100000:2.0:1789050272.687304:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740736 00000100:00100000:2.0:1789050272.687315:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740864 00000100:00100000:2.0:1789050272.687317:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740864 00000100:00100000:2.0:1789050272.687326:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714740992 00000100:00100000:2.0:1789050272.687329:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714740992 00000100:00100000:2.0:1789050272.687341:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050272.687349:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:20216:x1875954714740608:12345-0@lo:104: 00010000:00010000:2.0:1789050272.687362:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.687426:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050272.687432:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+6:20216:x1875954714740608:12345-0@lo:104: Request processed in 84us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.687439:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050272.687454:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050272.687460:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:20216:x1875954714740736:12345-0@lo:104: 00000100:00100000:0.0:1789050272.687464:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740608:0@lo:104: 00010000:00010000:2.0:1789050272.687475:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.687515:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789050272.687520:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+5:20216:x1875954714740736:12345-0@lo:104: Request processed in 61us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.687526:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050272.687539:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050272.687544:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:20216:x1875954714740864:12345-0@lo:104: 00010000:00010000:2.0:1789050272.687552:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.687584:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789050272.687589:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+4:20216:x1875954714740864:12345-0@lo:104: Request processed in 45us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.687594:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050272.687819:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050272.687828:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:20216:x1875954714740992:12345-0@lo:104: 00010000:00010000:3.0:1789050272.687837:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050272.688020:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789050272.688026:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+3:20216:x1875954714740992:12345-0@lo:104: Request processed in 200us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.688032:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789050272.688382:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789050272.688388:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688395:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602200 already unused, calling callback (ffffffffc1287c20) 10000000:00010000:2.0:1789050272.688399:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688407:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050272.688414:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050272.688429:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789050272.688474:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688481:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050272.688495:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789050272.688501:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688501:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688508:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae603a00 already unused, calling callback (ffffffffc1287c20) 00010000:00010000:2.0:1789050272.688509:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602200/0x3b8ec5973df5879c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df587a3 expref: -99 pid: 19511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050272.688511:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688518:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688520:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050272.688523:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050272.688525:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688530:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae602600 already unused, calling callback (ffffffffc1287c20) 10000000:01000000:1.0:1789050272.688531:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1789050272.688533:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688538:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050272.688544:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688545:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050272.688550:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050272.688551:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050272.688559:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688565:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050272.688565:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688571:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae603a00/0x3b8ec5973df58702 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df58709 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688575:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688580:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050272.688581:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8baaae602600/0x3b8ec5973df586c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586ca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688583:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688589:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571400 already unused, calling callback (ffffffffc1287c20) 00010000:00010000:2.0:1789050272.688591:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050272.688592:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050272.688594:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789050272.688596:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.688600:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050272.688603:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050272.688609:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050272.688614:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789050272.688624:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050272.688627:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688631:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050272.688637:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688643:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff8ba983571400/0x3b8ec5973df586b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3b8ec5973df586bc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.688655:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050272.688656:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050272.688657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050272.688658:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050272.688688:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050272.688693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050272.688712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.688735:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741120 00000100:00100000:2.0:1789050272.688740:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741120 00010000:00010000:2.0:1789050272.688759:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 24 pid: 17187 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050272.688778:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741504 00000100:00100000:2.0:1789050272.688781:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741504 00010000:00010000:2.0:1789050272.688791:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 25 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050272.688802:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050272.688853:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740736:0@lo:104: 00000100:00100000:0.0:1789050272.688864:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740864:0@lo:104: 00000100:00100000:0.0:1789050272.688871:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740992:0@lo:104: 00000100:00100000:2.0:1789050272.691544:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+25:3647:x1875954714741120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050272.691565:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050272.691574:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 25 pid: 17187 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.691614:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 25 pid: 17187 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.691632:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae603600/0x3b8ec5973df587a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df5879c expref: 25 pid: 17187 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050272.691641:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789050272.691646:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050272.691651:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3647:x1875954714741504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050272.691659:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050272.691664:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 24 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.691671:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 24 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.691686:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae694800/0x3b8ec5973df586bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df586b5 expref: 24 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.691696:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050272.691718:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:3647:x1875954714741120:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.691725:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050272.691775:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050272.691785:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050272.692200:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714741248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050272.692236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.692278:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050272.692285:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714741376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050272.692304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.692340:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789050272.692340:0:17178:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789050272.692347:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789050272.692349:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741248 00000100:00100000:0.0:1789050272.692355:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741248 00010000:00010000:0.0:1789050272.692375:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 23 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.692389:0:17178:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789050272.692393:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741376 00000100:00100000:0.0:1789050272.692395:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741376 00010000:00010000:0.0:1789050272.692403:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 24 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050272.692425:0:17178:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789050272.692432:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789050272.692438:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3644:x1875954714741248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050272.692446:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050272.692450:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 24 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692457:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 24 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692467:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae695e00/0x3b8ec5973df58709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df58702 expref: 24 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692475:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050272.692511:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:3644:x1875954714741248:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.692514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714741248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050272.692517:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789050272.692529:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050272.692538:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:3644:x1875954714741376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050272.692547:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050272.692551:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 22 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692558:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 22 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692567:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baaae695c00/0x3b8ec5973df586ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3b8ec5973df586c3 expref: 22 pid: 17186 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050272.692582:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050272.692613:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3644:x1875954714741376:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050272.692643:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:3647:x1875954714741504:12345-0@lo:103:ldlm_bl.0 Request processed in 994us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.692833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9e852cd-105e-4a2b-8f2f-088fc33df062:3644:1875954714741376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050272.692885:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050272.692922:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789050272.693604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050272.693884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050272.696375:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181120 00000100:00100000:2.0:1789050272.696389:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181120 00010000:00010000:2.0:1789050272.696430:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 13 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050272.696465:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181248 00000100:00100000:2.0:1789050272.696468:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181248 00010000:00010000:2.0:1789050272.696480:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 14 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050272.696512:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:1.0:1789050272.696512:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740352:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050272.696521:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85718850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+14:2404:x1875954704181120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789050272.696524:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875954714740480:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050272.696534:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050272.696539:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 14 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696549:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 14 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.696559:0:20216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696564:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d6600/0x3b8ec5973df589f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966eff expref: 14 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696578:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050272.696692:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85718850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2404:x1875954704181120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 171us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.696700:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789050272.696740:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789050272.696747:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:2404:x1875954704181248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050272.696755:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050272.696760:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696769:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696780:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df589b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966e8f expref: 12 pid: 17185 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696798:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696877:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696895:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696902:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696908:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696915:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696921:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d6000 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050272.696925:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.696934:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.697563:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050272.697576:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050272.697640:0:20216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.697648:0:20216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050272.697655:0:20216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a27 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050272.697681:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:2404:x1875954704181248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 931us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.697696:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:0.0:1789050272.816548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741632:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.816620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.817252:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741632 00000100:00100000:2.0:1789050272.817261:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741632 00000100:00100000:2.0:1789050272.817311:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789050272.817320:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:3647:x1875954714741632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714741760:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819296:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050272.819334:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050272.819341:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714741888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819366:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050272.819396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714742016:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819418:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050272.819471:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741760 00000100:00100000:3.0:1789050272.819479:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741760 00000100:00100000:3.0:1789050272.819520:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050272.819529:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714741760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819580:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714741760:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.819587:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050272.819610:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714741888 00000100:00100000:3.0:1789050272.819614:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714741888 00000100:00100000:3.0:1789050272.819643:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742016 00000100:00100000:3.0:1789050272.819646:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742016 00000100:00100000:3.0:1789050272.819667:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050272.819673:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714741888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819705:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714741888:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.819711:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050272.819722:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050272.819729:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714742016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819758:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714742016:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.819764:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789050272.819798:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050272.819803:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050272.819835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714742016:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714741888:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.819883:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714741760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.820295:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:3647:x1875954714741632:12345-0@lo:400:kworker.0 Request processed in 2974us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.820304:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789050272.820386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9e852cd-105e-4a2b-8f2f-088fc33df062:3647:1875954714741632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.820595:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050272.820698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714742272:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.820731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050272.820753:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050272.820759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714742400:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.820795:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050272.820822:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742272 00000100:00100000:0.0:1789050272.820827:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742272 00000100:00100000:0.0:1789050272.820866:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789050272.820874:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714742272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.820914:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714742272:12345-0@lo:400:kworker.0 Request processed in 42us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050272.820920:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789050272.820960:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742400 00000100:00100000:0.0:1789050272.820964:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742400 00000100:00100000:0.0:1789050272.820997:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789050272.821004:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714742400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.821058:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714742400:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050272.821064:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789050272.821081:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050272.821105:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714742400:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.821114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714742272:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714742528:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825263:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.825300:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714742144:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825326:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050272.825360:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742144 00000100:00100000:2.0:1789050272.825367:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742144 00000100:00100000:2.0:1789050272.825407:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050272.825416:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714742144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825465:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714742144:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.825472:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050272.825514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714742144:0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825565:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742528 00000100:00100000:2.0:1789050272.825569:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742528 00000100:00100000:2.0:1789050272.825605:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050272.825611:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714742528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050272.825660:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714742528:12345-0@lo:400:kworker.0 Request processed in 49us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050272.825666:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050272.825690:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714742528:0@lo:400:kworker.0 00000100:00100000:1.0:1789050272.826463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714742656:0@lo:400:kworker.0 00000100:00100000:1.0:1789050272.826499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050272.826522:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714743168:0@lo:400:kworker.0 00000100:00100000:1.0:1789050272.826542:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050272.826560:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050272.826565:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714743040:0@lo:400:kworker.0 00000100:00100000:1.0:1789050272.826603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050272.827362:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742656 00000100:00100000:3.0:1789050272.827370:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742656 00000100:00100000:3.0:1789050272.827398:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743168 00000100:00100000:3.0:1789050272.827400:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743168 00000100:00100000:3.0:1789050272.827415:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743040 00000100:00100000:3.0:1789050272.827417:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743040 00000100:00100000:3.0:1789050272.827434:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050272.827443:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714742656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.827497:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875954714742656:12345-0@lo:400:kworker.0 Request processed in 56us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.827504:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050272.827518:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050272.827524:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714743168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.827548:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875954714743168:12345-0@lo:400:kworker.0 Request processed in 26us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.827554:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050272.827563:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789050272.827569:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714743040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.827589:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875954714743040:12345-0@lo:400:kworker.0 Request processed in 21us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.827595:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789050272.827694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875954714743040:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.827779:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875954714742656:0@lo:400:kworker.0 00010000:00080000:3.0:1789050272.827795:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708a80 x1875954714743168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050272.827817:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875954714743168:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.829690:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714742912:0@lo:400:kworker.0 00000100:00100000:0.0:1789050272.829748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050272.829784:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050272.829790:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742912 00000100:00100000:0.0:1789050272.829793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714742784:0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.829800:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742912 00000100:00100000:0.0:1789050272.829822:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050272.829860:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714742784 00000100:00100000:3.0:1789050272.829864:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714742784 00000100:00100000:3.0:1789050272.829883:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050272.829891:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714742912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.829967:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875954714742912:12345-0@lo:400:kworker.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00080000:0.0:1789050272.830297:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050272.830301:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050272.830304:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050272.830329:0:17194:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789050272.830337:0:17194:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789050272.830360:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050272.830381:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789050272.830388:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714742784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050272.830421:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875954714742784:12345-0@lo:400:kworker.0 Request processed in 35us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050272.830428:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789050272.830467:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa8570b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875954714742784:0@lo:400:kworker.0 00010000:00080000:3.0:1789050272.830479:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baa85708380 x1875954714742912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050272.830488:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baa85708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875954714742912:0@lo:400:kworker.0 00000040:00080000:2.0:1789050273.264378:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789050273.642177:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050273.736392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050273.736748:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181376 00000100:00100000:1.0:1789050273.736757:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181376 00000100:00100000:1.0:1789050273.736807:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00100000:1.0:1789050273.736816:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+11:14932:x1875954704181376:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050273.736831:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050273.736857:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0e00/0x3b8ec5973df58a2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f37 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.736883:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0e00/0x3b8ec5973df58a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f37 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.736893:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0e00/0x3b8ec5973df58a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f37 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.736902:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0e00, rc 0) 00000100:00100000:1.0:1789050273.737374:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181376:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 557us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050273.737382:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00100000:0.0:1789050273.742706:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050273.742798:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181504 00000100:00100000:2.0:1789050273.742808:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181504 00000100:00100000:2.0:1789050273.742874:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:2.0:1789050273.742884:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181504:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050273.743404:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181504:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 510us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050273.743413:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:0.0:1789050273.748136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050273.748457:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181632 00000100:00100000:1.0:1789050273.748468:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181632 00000100:00100000:1.0:1789050273.748561:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:1.0:1789050273.748582:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181632:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050273.748737:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181632:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 157us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050273.748745:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:0.0:1789050273.756318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050273.756468:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181760 00000100:00100000:2.0:1789050273.756478:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181760 00000100:00100000:2.0:1789050273.756541:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:2.0:1789050273.756551:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+12:14932:x1875954704181760:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050273.756577:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050273.756595:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2176c00/0x3b8ec5973df58a35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f3e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.756623:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2176c00/0x3b8ec5973df58a35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f3e expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.756634:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2176c00/0x3b8ec5973df58a35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f3e expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.756660:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2176c00, rc 0) 00000100:00100000:2.0:1789050273.756719:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:14932:x1875954704181760:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050273.756726:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:0.0:1789050273.759717:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050273.759813:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181888 00000100:00100000:1.0:1789050273.759833:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181888 00000100:00100000:1.0:1789050273.759893:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:1.0:1789050273.759902:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:14932:x1875954704181888:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050273.760582:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:14932:x1875954704181888:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 677us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050273.760592:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:0.0:1789050273.763125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050273.763335:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182016 00000100:00100000:3.0:1789050273.763345:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182016 00000100:00100000:3.0:1789050273.763402:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 153 00000100:00100000:3.0:1789050273.763412:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:14932:x1875954704182016:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.764466:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:14932:x1875954704182016:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 1049us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050273.764486:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 153 10000000:01000000:3.0:1789050273.961559:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789050273.961566:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baa8374f000 from 13 10000000:01000000:3.0:1789050273.961571:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050273.961613:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050273.961624:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050273.961704:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050273.961731:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.961791:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050273.961832:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8512c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050273.962357:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743296 00000100:00100000:2.0:1789050273.962366:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743296 00000100:00100000:2.0:1789050273.962477:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789050273.962487:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+20:17189:x1875954714743296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050273.962501:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050273.962514:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baac2177600/0x3b8ec5973df58a43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58a3c expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.962537:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baac2177600/0x3b8ec5973df58a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58a3c expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.962547:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baac2177600/0x3b8ec5973df58a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58a3c expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050273.962556:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2177600, rc 0) 00000100:00100000:2.0:1789050273.962606:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050273.962613:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789050273.962780:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae709f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050273.962794:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a43 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.962803:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58a43 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050273.962880:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.962909:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050273.962948:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050273.963345:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743424 00000100:00100000:3.0:1789050273.963351:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743424 00000100:00100000:3.0:1789050273.963376:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789050273.963382:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.964123:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 736us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050273.964131:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789050273.964350:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.964469:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.964514:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050273.964538:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050273.964589:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743552 00000100:00100000:2.0:1789050273.964600:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743552 00000100:00100000:2.0:1789050273.964695:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789050273.964704:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050273.964790:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050273.964796:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789050273.965388:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789050273.968180:0:20268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789050273.971572:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789050273.971614:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050273.971626:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a43 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.971649:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baaae694c00/0x3b8ec5973df58a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a43 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050273.971658:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050273.971661:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8baa90bd4800 from 13 10000000:01000000:0.0:1789050273.971664:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050273.971698:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.971706:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.971717:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050273.971754:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.971819:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050273.971905:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050273.982541:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743680 00000100:00100000:1.0:1789050273.982556:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743680 00000100:00100000:1.0:1789050273.982610:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789050273.982619:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+21:17189:x1875954714743680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050273.982647:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050273.982666:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db1600/0x3b8ec5973df58a51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58a4a expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.982692:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db1600/0x3b8ec5973df58a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58a4a expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.982704:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db1600/0x3b8ec5973df58a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58a4a expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.982711:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1600, rc 0) 00000100:00100000:1.0:1789050273.982787:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba9832c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714743680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (10967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050273.982794:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789050273.984763:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050273.984792:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a51 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050273.984814:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58a51 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050273.984904:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.984988:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050273.985036:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8512cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050273.985211:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743808 00000100:00100000:0.0:1789050273.985218:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743808 00000100:00100000:0.0:1789050273.985260:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789050273.985278:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714743808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.985403:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714743808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050273.985411:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789050273.985703:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.985734:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae70a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050273.985776:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050273.985810:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8512cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050273.985856:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714743936 00000100:00100000:1.0:1789050273.985860:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714743936 00000100:00100000:1.0:1789050273.985896:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789050273.985903:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714743936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050273.986012:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714743936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050273.986019:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789050273.986074:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae70a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714743936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789050273.989868:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789050273.996304:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789050273.996342:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050273.996354:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a51 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050273.996365:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa829d6200/0x3b8ec5973df58a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a51 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050273.996475:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050273.996479:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba9834d3800 from 13 10000000:01000000:0.0:1789050273.996482:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050273.996522:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.996531:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.996542:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050273.996566:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.996628:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050273.996989:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789050273.997174:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744064 00000100:00100000:1.0:1789050273.997183:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744064 00000100:00100000:1.0:1789050273.997243:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789050273.997252:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+22:17189:x1875954714744064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050273.997266:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050273.997288:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df58a5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58a58 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.997311:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df58a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58a58 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.997320:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa86db0000/0x3b8ec5973df58a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58a58 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050273.997328:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db0000, rc 0) 00000100:00100000:1.0:1789050273.997367:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050273.997374:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789050273.999331:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050273.999356:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a5f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050273.999376:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58a5f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050273.999669:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050273.999718:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050273.999757:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba9844b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789050273.999934:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744192 00000100:00100000:3.0:1789050273.999964:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744192 00000100:00100000:3.0:1789050274.000011:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789050274.000031:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050274.000157:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050274.000164:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789050274.000417:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.000454:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.000494:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050274.000511:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ba98346d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789050274.000613:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744320 00000100:00100000:0.0:1789050274.000619:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744320 00000100:00100000:0.0:1789050274.000653:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789050274.000660:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050274.000742:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050274.000749:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789050274.001234:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789050274.005594:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789050274.009169:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789050274.009330:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050274.009342:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a5f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050274.009353:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baa829d6e00/0x3b8ec5973df58a58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a5f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050274.009372:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050274.009375:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba983e8d000 from 13 10000000:01000000:2.0:1789050274.009377:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050274.009482:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050274.009491:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050274.009518:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050274.009543:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.009608:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050274.009650:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050274.009702:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744448 00000100:00100000:0.0:1789050274.009710:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744448 00000100:00100000:0.0:1789050274.009780:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789050274.009788:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+23:17189:x1875954714744448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050274.009800:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050274.009811:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8ec5973df58a66 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050274.009832:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3b8ec5973df58a66 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050274.009852:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8baa829d6000/0x3b8ec5973df58a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3b8ec5973df58a66 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050274.009872:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa829d6000, rc 0) 00000100:00100000:0.0:1789050274.009926:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714744448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050274.009932:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789050274.010340:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050274.010354:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a6d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050274.010364:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3b8ec5973df58a6d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050274.010429:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.010454:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050274.010724:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744576 00000100:00100000:1.0:1789050274.010729:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744576 00000100:00100000:1.0:1789050274.010752:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789050274.010758:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714744576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050274.010862:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714744576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050274.010868:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789050274.011291:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050274.011307:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.011339:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050274.011381:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050274.011469:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab434b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050274.011523:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744704 00000100:00100000:0.0:1789050274.011528:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744704 00000100:00100000:0.0:1789050274.011594:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789050274.011601:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714744704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050274.011686:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:17189:x1875954714744704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050274.011694:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789050274.011773:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9e852cd-105e-4a2b-8f2f-088fc33df062:17189:1875954714744704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050274.013104:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789050274.021893:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789050274.021959:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050274.021971:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a6d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050274.021984:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff8baac2177c00/0x3b8ec5973df58a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3b8ec5973df58a6d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050274.665567:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050274.921389:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714744832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789050274.921451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050274.921546:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744832 00000100:00100000:1.0:1789050274.921553:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744832 00000100:00100000:1.0:1789050274.921621:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789050274.921630:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714744832:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789050274.921643:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789050274.921662:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789050274.921711:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714744832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050274.921718:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050274.922065:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba981b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714744832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789050274.922172:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050274.922183:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714744960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050274.922216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050274.922589:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714744960 00000100:00100000:3.0:1789050274.922594:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714744960 00000100:00100000:3.0:1789050274.922636:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789050274.922643:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714744960:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050274.922657:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789050274.922660:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789050274.922703:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba981b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714744960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050274.922710:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050274.922740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714744960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050274.922906:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714745088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050274.922957:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050274.922985:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714745088 00000100:00100000:0.0:1789050274.922990:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714745088 00000100:00100000:0.0:1789050274.923027:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789050274.923035:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714745088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050274.923047:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789050274.923092:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714745088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050274.923098:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789050274.923116:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050274.923166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714745088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050275.276783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.276898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.276995:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277043:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277063:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277080:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050275.277149:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182656 00000100:00100000:0.0:1789050275.277158:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182656 00000100:00100000:0.0:1789050275.277211:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183168 00000100:00100000:0.0:1789050275.277214:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183168 00000100:00100000:0.0:1789050275.277227:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182528 00000100:00100000:0.0:1789050275.277438:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182528 00000100:00100000:0.0:1789050275.277463:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183040 00000100:00100000:0.0:1789050275.277466:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183040 00000100:00100000:0.0:1789050275.277485:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050275.277494:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182656:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.277711:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182656:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 217us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.277719:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050275.277737:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050275.277744:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704183168:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.277771:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704183168:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.277777:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050275.277790:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050275.277796:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182528:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.277819:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182528:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.277824:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789050275.277847:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050275.277853:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704183040:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.277874:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704183040:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 22us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.277880:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050275.277900:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182400 00000100:00100000:0.0:1789050275.277904:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182400 00000100:00100000:0.0:1789050275.277925:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182912 00000100:00100000:0.0:1789050275.277928:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182912 00000100:00100000:0.0:1789050275.277966:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182272 00000100:00100000:0.0:1789050275.277970:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182272 00000100:00100000:0.0:1789050275.277993:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182784 00000100:00100000:0.0:1789050275.277996:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182784 00000100:00100000:0.0:1789050275.278010:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789050275.278016:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182400:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.278042:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704182400:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.278048:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789050275.278060:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789050275.278066:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704182912:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.278088:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704182912:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.278094:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789050275.278105:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:0.0:1789050275.278111:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2405:x1875954704182272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.278130:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:2405:x1875954704182272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 20us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.278135:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:0.0:1789050275.278144:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:0.0:1789050275.278149:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2405:x1875954704182784:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050275.278166:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2405:x1875954704182784:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 17us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050275.278171:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00080000:0.0:1789050275.278195:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050275.278198:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050275.278201:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050275.278209:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050275.283292:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182144 00000100:00100000:2.0:1789050275.283320:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182144 00000100:00100000:2.0:1789050275.283379:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:2.0:1789050275.283389:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2405:x1875954704182144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789050275.283469:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2405:x1875954704182144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 81us (6695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050275.283477:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 166 00010000:00010000:1.0:1789050275.691912:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050275.951212:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050275.951236:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714745216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050275.951303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050275.951393:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714745216 00000100:00100000:3.0:1789050275.951401:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714745216 00000100:00100000:3.0:1789050275.951467:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050275.951476:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714745216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050275.951499:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789050275.951542:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714745216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050275.951550:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789050275.951602:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050275.951635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714745216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789050276.457240:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baaae708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714745344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050276.457314:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050276.457416:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714745344 00000100:00100000:3.0:1789050276.457428:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714745344 00000100:00100000:0.0:1789050276.457447:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050276.457455:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714745472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789050276.457481:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050276.457489:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714745472 00000100:00100000:3.0:1789050276.457492:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714745472 00000100:00100000:3.0:1789050276.457509:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050276.457603:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714745344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050276.457638:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789050276.457708:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714745344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050276.457768:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baaae708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714745344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789050276.464999:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789050276.465027:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714745472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050276.465087:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050276.465181:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714745472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (7697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050276.465188:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789050276.466264:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714745472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050276.471171:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789050276.613908:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050276.614464:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183296 00000100:00100000:2.0:1789050276.614473:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183296 00000100:00100000:2.0:1789050276.614536:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789050276.614545:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+6:15596:x1875954704183296:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050276.614564:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050276.614587:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df58a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f45 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.614646:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615557:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615578:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615597:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615605:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615612:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615709:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031800/0x3b8ec5973df58a89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615719:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031800/0x3b8ec5973df58a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615726:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031800/0x3b8ec5973df58a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050276.615757:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789050276.615761:0:17194:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050276.615797:0:17194:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031800/0x3b8ec5973df58a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615809:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615816:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615833:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615839:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2176800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050276.615843:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615850:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615862:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:2.0:1789050276.615871:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050276.615876:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615882:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2176800/0x3b8ec5973df58a7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615897:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615903:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615908:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615912:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2177400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050276.615915:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615921:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.615930:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8baa88800500) 00010000:00010000:2.0:1789050276.615932:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050276.616594:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.616605:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177400/0x3b8ec5973df58a82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.616647:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2177000/0x3b8ec5973df58a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f45 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.616675:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031800/0x3b8ec5973df58a89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f45 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.616683:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baa88800d00) 00010000:00010000:2.0:1789050276.616685:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050276.616688:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031800, rc 0) 00000100:00100000:2.0:1789050276.616767:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+7:15596:x1875954704183296:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2223us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050276.616776:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:1.0:1789050276.621176:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.621336:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183424 00000100:00100000:0.0:1789050276.621348:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183424 00000100:00100000:0.0:1789050276.621414:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789050276.621425:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:401f46b2-7a10-4bef-9b8f-516c59334602+7:15596:x1875954704183424:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789050276.621521:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:401f46b2-7a10-4bef-9b8f-516c59334602+7:15596:x1875954704183424:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050276.621529:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789050276.624855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050276.624969:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183680 00000100:00100000:3.0:1789050276.624978:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183680 00000100:00100000:3.0:1789050276.625026:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:3.0:1789050276.625044:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+7:15596:x1875954704183680:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050276.625063:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050276.625234:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58a90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f4c expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625317:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625333:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625344:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625359:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625366:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625374:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625477:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58aa5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625504:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625512:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050276.625524:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789050276.625667:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625676:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625682:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625687:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae694800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050276.625692:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625699:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625711:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baa88800d00) 00010000:00010000:3.0:1789050276.625714:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050276.625719:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625725:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58a97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625737:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625749:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625755:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625760:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:3.0:1789050276.625763:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625770:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625778:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8baa9307bb00) 00010000:00010000:3.0:1789050276.625780:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050276.625782:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.625787:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58a9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.629575:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58a90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f4c expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.629601:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695e00/0x3b8ec5973df58aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f4c expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.629610:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:3.0:1789050276.629613:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050276.629624:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695e00, rc 0) 00000100:00100000:3.0:1789050276.629752:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+9:15596:x1875954704183680:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 4709us (4904us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789050276.629761:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:3.0:1789050276.652053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.652534:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183808 00000100:00100000:0.0:1789050276.652547:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183808 00000100:00100000:0.0:1789050276.652615:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789050276.652626:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+9:15596:x1875954704183808:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789050276.652751:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+9:15596:x1875954704183808:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 126us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050276.652775:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789050276.660926:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.661391:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183936 00000100:00100000:0.0:1789050276.661401:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183936 00000100:00100000:0.0:1789050276.661517:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:0.0:1789050276.661528:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:15596:x1875954704183936:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789050276.669074:0:17193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7468us 00000100:00100000:2.0:1789050276.673288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.673426:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184064 00000100:00100000:1.0:1789050276.673437:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184064 00000100:00100000:1.0:1789050276.673489:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:1.0:1789050276.673499:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+9:15602:x1875954704184064:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050276.673529:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050276.673550:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f53 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673610:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673624:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673635:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673650:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673657:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673664:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673717:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673725:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673731:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673737:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa86db1400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050276.673748:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673755:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673767:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:1.0:1789050276.673770:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050276.673775:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673783:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1400/0x3b8ec5973df58aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673794:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673800:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673806:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673811:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050276.673814:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673829:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673837:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:1.0:1789050276.673839:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050276.673851:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673857:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673889:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58ab3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f53 expref: 10 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673900:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:1.0:1789050276.673902:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050276.673906:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db1800/0x3b8ec5973df58ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f53 expref: 10 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.673916:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa86db1800, rc 0) 00000100:00100000:1.0:1789050276.674005:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+9:15602:x1875954704184064:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 507us (727us total) trans 0 rc 301/301 00000100:00100000:1.0:1789050276.674013:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:1.0:1789050276.688665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050276.689444:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184192 00000100:00100000:2.0:1789050276.689454:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184192 00000100:00100000:2.0:1789050276.689509:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789050276.689520:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:401f46b2-7a10-4bef-9b8f-516c59334602+9:15602:x1875954704184192:12345-192.168.203.42@tcp:700:lfs.0 00000100:00100000:2.0:1789050276.689622:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:401f46b2-7a10-4bef-9b8f-516c59334602+9:15602:x1875954704184192:12345-192.168.203.42@tcp:700:lfs.0 Request processed in 102us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050276.689629:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:3.0:1789050276.695112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.695230:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184448 00000100:00100000:1.0:1789050276.695240:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184448 00000100:00100000:1.0:1789050276.695306:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:1.0:1789050276.695316:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+9:15602:x1875954704184448:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:1.0:1789050276.695365:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050276.695389:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0600/0x3b8ec5973df589e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ec0 expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.695408:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:1.0:1789050276.695426:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050276.695479:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.695493:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.695501:0:17192:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.695546:0:17192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.695560:0:17192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 5 pid: 17192 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050276.695574:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17192:1875954714745600:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050276.695655:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa8488c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050276.701841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050276.701889:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184576 00000100:00100000:3.0:1789050276.701898:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184576 00010000:00010000:3.0:1789050276.701963:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 6 pid: 17192 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050276.702001:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:3.0:1789050276.702011:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2404:x1875954704184576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050276.702024:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050276.702030:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 6 pid: 17192 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.702043:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 6 pid: 17192 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.702064:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:3.0:1789050276.702082:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.702092:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.702100:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.702132:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050276.702178:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecbb0205-dfd3-498a-b75f-85e633519280+6:2404:x1875954704184576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 168us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050276.702187:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00010000:00010000:1.0:1789050276.704238:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa86db0400/0x3b8ec5973df58a20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f30 expref: 5 pid: 17192 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050276.704266:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17192:1875954714745600:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050276.704289:0:17192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.704316:0:17192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.704322:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.704362:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.704375:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.704386:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.708871:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.708895:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.708913:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050276.708929:0:17192:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007fd60a7a reply state 00000000a2c77443 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.708966:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709101:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:0.0:1789050276.709104:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050276.709108:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789050276.709114:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789050276.709122:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709129:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709136:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709151:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050276.709156:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709165:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709176:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba983288200) 00010000:00010000:0.0:1789050276.709179:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050276.709182:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709188:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043c00/0x3b8ec5973df58ac8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050276.709209:0:17192:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007fd60a7a reply state 00000000a2c77443 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709217:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.709224:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:0.0:1789050276.709226:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789050276.709228:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789050276.709327:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+10:15602:x1875954704184448:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 14009us (14222us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789050276.709338:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:3.0:1789050276.714010:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050276.714345:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:15596:x1875954704183936:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 52806us (53418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050276.714362:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:3.0:1789050276.841529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050276.841968:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184704 00000100:00100000:2.0:1789050276.841979:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184704 00000100:00100000:2.0:1789050276.842126:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:2.0:1789050276.842138:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+10:15610:x1875954704184704:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:2.0:1789050276.842162:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050276.842184:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f5a expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842270:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df58ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842284:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df58ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842295:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df58ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050276.842338:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789050276.842342:0:17194:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050276.842380:0:17194:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df58ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842403:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f5a expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842421:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030200/0x3b8ec5973df58ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f5a expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050276.842429:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:2.0:1789050276.842433:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050276.842436:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030200, rc 0) 00000100:00100000:2.0:1789050276.842497:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+11:15610:x1875954704184704:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 362us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050276.842504:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:2.0:1789050276.875599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.876652:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184832 00000100:00100000:0.0:1789050276.876665:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184832 00000100:00100000:0.0:1789050276.876749:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789050276.876772:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+5:15611:x1875954704184832:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050276.876792:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050276.876813:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6600/0x3b8ec5973df58aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f61 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.876885:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.876900:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.876910:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050276.877232:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789050276.877238:0:17192:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050276.877262:0:17192:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.877289:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d6600/0x3b8ec5973df58aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f61 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.877310:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571400/0x3b8ec5973df58af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f61 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.877319:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:0.0:1789050276.877321:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050276.877325:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983571400, rc 0) 00000100:00100000:0.0:1789050276.877400:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+6:15611:x1875954704184832:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 630us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050276.877417:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:3.0:1789050276.884560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.884725:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184960 00000100:00100000:1.0:1789050276.884735:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184960 00000100:00100000:1.0:1789050276.884796:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:1.0:1789050276.884806:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecbb0205-dfd3-498a-b75f-85e633519280+6:15611:x1875954704184960:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050276.884837:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050276.884859:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f68 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.884927:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.884979:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885001:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885034:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885042:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885049:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885123:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885132:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885139:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050276.885173:0:20230:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789050276.885177:0:20230:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050276.885198:0:20230:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885210:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885216:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885222:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885238:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050276.885242:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885249:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885261:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:1.0:1789050276.885264:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050276.885269:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885275:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885288:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885294:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885299:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885304:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050276.885307:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885314:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885333:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:1.0:1789050276.885335:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050276.885338:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885344:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885369:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f68 expref: 8 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885384:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f68 expref: 7 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.885391:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:1.0:1789050276.885393:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050276.885396:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042e00, rc 0) 00000100:00100000:1.0:1789050276.885452:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecbb0205-dfd3-498a-b75f-85e633519280+7:15611:x1875954704184960:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 647us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050276.885459:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:3.0:1789050276.889091:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.889512:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185088 00000100:00100000:0.0:1789050276.889523:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185088 00000100:00100000:0.0:1789050276.889591:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789050276.889601:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ecbb0205-dfd3-498a-b75f-85e633519280+5:15611:x1875954704185088:12345-192.168.203.42@tcp:900:lfs.0 00000100:00100000:0.0:1789050276.889699:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ecbb0205-dfd3-498a-b75f-85e633519280+5:15611:x1875954704185088:12345-192.168.203.42@tcp:900:lfs.0 Request processed in 90us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050276.889708:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789050276.892903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.893152:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185344 00000100:00100000:1.0:1789050276.893162:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185344 00000100:00100000:1.0:1789050276.893217:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:1.0:1789050276.893229:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+7:15611:x1875954704185344:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050276.893249:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050276.893268:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f6f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050276.893385:0:17193:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789050276.893561:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f6f expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.893648:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:1.0:1789050276.893653:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050276.893660:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f6f expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.893673:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043600, rc 0) 00000100:00100000:1.0:1789050276.893801:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+8:15611:x1875954704185344:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 574us (906us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789050276.893809:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:3.0:1789050276.896329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.897152:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185600 00000100:00100000:1.0:1789050276.897166:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185600 00000100:00100000:1.0:1789050276.897236:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:1.0:1789050276.897247:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecbb0205-dfd3-498a-b75f-85e633519280+8:15611:x1875954704185600:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:1.0:1789050276.897299:0:20230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050276.897324:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f68 expref: 8 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.897344:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:1.0:1789050276.897349:0:20230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050276.897368:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.897401:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.897412:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050276.899920:0:20230:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000aa09d492 reply state 000000006c96678d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.899962:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050276.899972:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:1.0:1789050276.899975:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789050276.899980:0:20230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789050276.900234:0:20230:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789050276.900349:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecbb0205-dfd3-498a-b75f-85e633519280+9:15611:x1875954704185600:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 3101us (4029us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789050276.900358:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:3.0:1789050276.903332:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.906468:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185856 00000100:00100000:1.0:1789050276.906481:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185856 00000100:00100000:1.0:1789050276.906528:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789050276.906534:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecbb0205-dfd3-498a-b75f-85e633519280+9:15611:x1875954704185856:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050276.906739:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecbb0205-dfd3-498a-b75f-85e633519280+10:15611:x1875954704185856:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 204us (3803us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789050276.906744:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:3.0:1789050276.910313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.911128:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186112 00000100:00100000:0.0:1789050276.911138:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186112 00000100:00100000:0.0:1789050276.911200:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:0.0:1789050276.911211:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+10:15611:x1875954704186112:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789050276.911237:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050276.911267:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f76 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911353:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911368:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911379:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911389:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911414:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911421:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050276.911530:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789050276.911615:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911622:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911629:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911636:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050276.911641:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911648:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911659:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:0.0:1789050276.911663:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050276.911667:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.911674:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570400/0x3b8ec5973df58b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914222:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914239:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914247:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914252:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050276.914256:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914264:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914279:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:0.0:1789050276.914282:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050276.914287:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914293:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58b38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914345:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58b2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f76 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914356:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:0.0:1789050276.914359:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050276.914380:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f76 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050276.914391:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570c00, rc 0) 00000100:00100000:0.0:1789050276.914473:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecbb0205-dfd3-498a-b75f-85e633519280+11:15611:x1875954704186112:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3263us (4168us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789050276.914481:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:0.0:1789050276.920600:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050276.920740:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186240 00000100:00100000:3.0:1789050276.920750:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186240 00000100:00100000:3.0:1789050276.920826:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:3.0:1789050276.920836:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+11:15611:x1875954704186240:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789050276.920870:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050276.920891:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58b46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f7d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921038:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921054:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921066:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050276.921114:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789050276.921118:0:17194:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789050276.921138:0:17194:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921163:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58b46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921181:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050276.921190:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:3.0:1789050276.921193:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050276.921196:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695c00, rc 0) 00000100:00100000:3.0:1789050276.921268:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecbb0205-dfd3-498a-b75f-85e633519280+12:15611:x1875954704186240:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 433us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050276.921275:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:3.0:1789050276.925374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050276.930580:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186368 00000100:00100000:0.0:1789050276.930594:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186368 00000100:00100000:0.0:1789050276.930651:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789050276.930662:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecbb0205-dfd3-498a-b75f-85e633519280+12:15611:x1875954704186368:12345-192.168.203.42@tcp:37:lfs.0 00000100:00100000:2.0:1789050276.948073:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecbb0205-dfd3-498a-b75f-85e633519280+12:15611:x1875954704186368:12345-192.168.203.42@tcp:37:lfs.0 Request processed in 17403us (22700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050276.948096:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:3.0:1789050276.955056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050276.955161:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186624 00000100:00100000:1.0:1789050276.955170:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186624 00000100:00100000:1.0:1789050276.955254:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789050276.955265:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaaea20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecbb0205-dfd3-498a-b75f-85e633519280+12:15611:x1875954704186624:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050276.955490:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaaea20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecbb0205-dfd3-498a-b75f-85e633519280+13:15611:x1875954704186624:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 225us (443us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789050276.955497:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:3.0:1789050277.023035:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.023188:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186752 00000100:00100000:1.0:1789050277.023198:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186752 00000100:00100000:1.0:1789050277.023274:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:1.0:1789050277.023287:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+11:15617:x1875954704186752:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789050277.023307:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050277.023328:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f84 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023393:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023409:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023420:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023431:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023438:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023445:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023535:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df58b69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023544:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df58b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023561:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df58b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050277.023603:0:17193:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789050277.023607:0:17193:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050277.023641:0:17193:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df58b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023653:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023659:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023666:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023672:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050277.023676:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023683:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023695:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:1.0:1789050277.023704:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050277.023710:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023717:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023732:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023738:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023745:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023750:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042800 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050277.023753:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023759:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023766:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:1.0:1789050277.023768:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050277.023771:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023777:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023803:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f84 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023841:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043200/0x3b8ec5973df58b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f84 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.023849:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:1.0:1789050277.023851:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789050277.023854:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043200, rc 0) 00000100:00100000:1.0:1789050277.023916:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+12:15617:x1875954704186752:12345-192.168.203.42@tcp:101:bash.0 Request processed in 632us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050277.023923:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00080000:0.0:1789050277.024144:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050277.029489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050277.029587:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186880 00000100:00100000:0.0:1789050277.029598:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186880 00000100:00100000:0.0:1789050277.029674:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789050277.029686:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:401f46b2-7a10-4bef-9b8f-516c59334602+5:15617:x1875954704186880:12345-192.168.203.42@tcp:900:bash.0 00000100:00100000:0.0:1789050277.029775:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:401f46b2-7a10-4bef-9b8f-516c59334602+5:15617:x1875954704186880:12345-192.168.203.42@tcp:900:bash.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050277.029783:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00080000:1.0:1789050277.029852:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050277.032725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050277.032839:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187136 00000100:00100000:2.0:1789050277.032849:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187136 00000100:00100000:2.0:1789050277.032914:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:2.0:1789050277.032925:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+12:15617:x1875954704187136:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789050277.032998:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050277.033021:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58b70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f8b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.033125:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.033140:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.033149:0:17194:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.033181:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.033195:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 12 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050277.033209:0:17194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745728:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050277.033299:0:17194:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa904e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050277.036133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050277.036225:0:20218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187264 00000100:00100000:0.0:1789050277.036234:0:20218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187264 00010000:00010000:0.0:1789050277.036285:0:20218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 13 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050277.036325:0:20218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789050277.036335:0:20218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecbb0205-dfd3-498a-b75f-85e633519280+13:2404:x1875954704187264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050277.036362:0:20218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050277.036370:0:20218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 13 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.036383:0:20218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 13 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.036402:0:20218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:0.0:1789050277.036407:0:20218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.036417:0:20218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.036425:0:20218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.036441:0:20218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050277.036482:0:20218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecbb0205-dfd3-498a-b75f-85e633519280+13:2404:x1875954704187264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050277.036490:0:20218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00080000:1.0:1789050277.036557:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050277.037428:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695c00/0x3b8ec5973df58b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f7d expref: 12 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050277.037457:0:17194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745728:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050277.037476:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.037486:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.037493:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.037515:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.037525:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.037533:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038130:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038141:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038149:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050277.038160:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050277.038185:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038200:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038207:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038213:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050277.038217:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038225:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038236:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:2.0:1789050277.038239:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050277.038256:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038263:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58b77 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050277.038275:0:17194:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002f632e67 reply state 00000000eadeb15c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038285:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038292:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8baa88800c00) 00010000:00010000:2.0:1789050277.038294:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789050277.038297:0:17194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050277.038328:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58b70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038351:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.038358:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:2.0:1789050277.038361:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789050277.038363:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030800, rc 0) 00000100:00100000:2.0:1789050277.038418:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+15:15617:x1875954704187136:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5494us (5702us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789050277.038426:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:3.0:1789050277.055386:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.055491:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187392 00000100:00100000:1.0:1789050277.055501:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187392 00000100:00100000:1.0:1789050277.055563:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:1.0:1789050277.055573:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+15:15617:x1875954704187392:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789050277.055596:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050277.055616:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f92 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055681:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055702:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055714:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050277.055784:0:17193:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789050277.055788:0:17193:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789050277.055806:0:17193:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055828:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055852:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58b93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055871:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.055880:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050277.055883:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050277.055886:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042800, rc 0) 00000100:00100000:1.0:1789050277.055997:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+16:15617:x1875954704187392:12345-192.168.203.42@tcp:101:bash.0 Request processed in 425us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050277.056004:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:0.0:1789050277.062145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.062230:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187648 00000100:00100000:1.0:1789050277.062240:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187648 00000100:00100000:1.0:1789050277.062305:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789050277.062315:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+16:15617:x1875954704187648:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:1.0:1789050277.062520:0:17196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:1.0:1789050277.062624:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+18:15617:x1875954704187648:12345-192.168.203.42@tcp:35:bash.0 Request processed in 310us (488us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789050277.062649:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000020:00080000:1.0:1789050277.062654:0:17196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789050277.163438:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050277.169034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.169179:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187904 00000100:00100000:1.0:1789050277.169189:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187904 00000100:00100000:1.0:1789050277.169268:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:1.0:1789050277.169279:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+18:15627:x1875954704187904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050277.169304:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050277.169323:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966f99 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050277.169420:0:20230:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789050277.169515:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58ba1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f99 expref: 20 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.169530:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baa88800500) 00010000:00010000:1.0:1789050277.169533:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050277.169539:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f99 expref: 20 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.169554:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042e00, rc 0) 00000100:00100000:1.0:1789050277.169845:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+19:15627:x1875954704187904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 568us (820us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1789050277.169853:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:3.0:1789050277.171975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.172071:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704188160 00000100:00100000:1.0:1789050277.172082:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704188160 00000100:00100000:1.0:1789050277.172138:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:1.0:1789050277.172147:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+19:15627:x1875954704188160:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050277.172361:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+20:15627:x1875954704188160:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 214us (423us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789050277.172369:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789050277.250920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.251581:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704188416 00000100:00100000:1.0:1789050277.251594:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704188416 00000100:00100000:1.0:1789050277.251664:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:1.0:1789050277.251674:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+20:15630:x1875954704188416:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789050277.251698:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050277.251716:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58baf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fa0 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.251853:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58bb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.251868:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.251880:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050277.251892:0:17193:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789050277.252406:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58baf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa0 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.252426:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa0 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.252434:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050277.252445:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050277.252449:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043600, rc 0) 00000100:00100000:1.0:1789050277.252990:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+22:15630:x1875954704188416:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1315us (2075us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789050277.252999:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:3.0:1789050277.261233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.262623:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704188544 00000100:00100000:1.0:1789050277.262635:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704188544 00000100:00100000:1.0:1789050277.262699:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:1.0:1789050277.262709:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+22:15630:x1875954704188544:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789050277.262771:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262786:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262797:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262840:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262847:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262853:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262859:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050277.262863:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262883:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262896:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050277.262899:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050277.262903:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.262909:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58bc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050277.263189:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+22:15630:x1875954704188544:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 480us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050277.263197:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:3.0:1789050277.264649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050277.264737:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704188672 00000100:00100000:2.0:1789050277.264745:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704188672 00000100:00100000:2.0:1789050277.264804:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789050277.264823:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+22:2403:x1875954704188672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050277.264837:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050277.264858:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58bb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa0 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.264876:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:2.0:1789050277.264881:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050277.264932:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+21:2403:x1875954704188672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050277.264980:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:0.0:1789050277.270555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.270670:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704188928 00000100:00100000:1.0:1789050277.270680:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704188928 00000100:00100000:1.0:1789050277.270735:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789050277.270746:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+21:15630:x1875954704188928:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789050277.271647:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+22:15630:x1875954704188928:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 898us (1097us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789050277.271657:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000040:00080000:2.0:1789050277.367655:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789050277.616037:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050277.616116:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704189184 00000100:00100000:2.0:1789050277.616151:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704189184 00000100:00100000:2.0:1789050277.616208:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:2.0:1789050277.616218:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+22:15662:x1875954704189184:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789050277.616242:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050277.616262:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58bcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fa7 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.616365:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.616380:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.616393:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050277.616404:0:17192:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050277.616524:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58bcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa7 expref: 25 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.616543:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa7 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.616551:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:2.0:1789050277.616554:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050277.616557:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030600, rc 0) 00000100:00100000:2.0:1789050277.616619:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+24:15662:x1875954704189184:12345-192.168.203.42@tcp:101:cat.0 Request processed in 402us (591us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789050277.616627:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:3.0:1789050277.626546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050277.626611:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050277.626708:0:20218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704189312 00000100:00100000:0.0:1789050277.626718:0:20218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704189312 00000100:00100000:0.0:1789050277.626780:0:20218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:0.0:1789050277.626790:0:20218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:401f46b2-7a10-4bef-9b8f-516c59334602+24:2404:x1875954704189312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050277.626826:0:20218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050277.626852:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030600/0x3b8ec5973df58bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fa7 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050277.626859:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704189568 00000100:00100000:1.0:1789050277.626866:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704189568 00010000:00010000:0.0:1789050277.626872:0:20218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050277.626879:0:20218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050277.626911:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789050277.626921:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+24:15662:x1875954704189568:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1789050277.626988:0:20218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:401f46b2-7a10-4bef-9b8f-516c59334602+24:2404:x1875954704189312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 197us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050277.626996:0:20218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000001:00080000:1.0:1789050277.627362:0:17196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934608 00000100:00100000:1.0:1789050277.627489:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:401f46b2-7a10-4bef-9b8f-516c59334602+25:15662:x1875954704189568:12345-192.168.203.42@tcp:35:cat.0 Request processed in 569us (876us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1789050277.627505:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000020:00080000:1.0:1789050277.627510:0:17196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050277.720191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050277.720486:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704189824 00000100:00100000:2.0:1789050277.720497:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704189824 00000100:00100000:2.0:1789050277.720562:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:2.0:1789050277.720572:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+25:15668:x1875954704189824:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:2.0:1789050277.720595:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050277.720617:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58be0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fae expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720720:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720735:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720744:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 26 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720751:0:17194:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720787:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 26 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.720800:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 26 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050277.720829:0:17194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745856:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050277.720926:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050277.721004:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050277.721014:0:17194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745984:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050277.721045:0:17194:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050277.726525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050277.726567:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050277.726693:0:17194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745856:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050277.726706:0:17194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1875954714745984:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789050277.726728:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050277.728016:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704189952 00000100:00100000:1.0:1789050277.728028:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704189952 00010000:00010000:0.0:1789050277.728407:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 27 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050277.728556:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190080 00000100:00100000:0.0:1789050277.728561:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190080 00010000:00010000:0.0:1789050277.728579:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 28 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050277.728612:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050277.728621:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:401f46b2-7a10-4bef-9b8f-516c59334602+28:2404:x1875954704189952:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050277.728635:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050277.728641:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 28 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728653:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 28 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728688:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58b9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f92 expref: 28 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728708:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050277.728714:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728722:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728728:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050277.728784:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:401f46b2-7a10-4bef-9b8f-516c59334602+27:2404:x1875954704189952:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 163us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050277.728791:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789050277.728807:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789050277.728826:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa8571a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:401f46b2-7a10-4bef-9b8f-516c59334602+26:2404:x1875954704190080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050277.728833:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050277.728838:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728848:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728860:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58b85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966f8b expref: 26 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728883:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050277.728888:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728895:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728903:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.728927:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050277.728993:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa8571a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:401f46b2-7a10-4bef-9b8f-516c59334602+25:2404:x1875954704190080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 168us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050277.729000:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00010000:00010000:0.0:1789050277.729062:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.729069:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050277.729087:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789050277.729332:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58be0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fae expref: 26 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.729350:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030e00/0x3b8ec5973df58be7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fae expref: 25 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050277.729359:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050277.729368:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050277.729371:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030e00, rc 0) 00000100:00100000:0.0:1789050277.729397:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+25:15668:x1875954704189824:12345-192.168.203.42@tcp:101:dd.0 Request processed in 8827us (9217us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789050277.729404:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789050277.733662:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050277.734129:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190208 00000100:00100000:3.0:1789050277.734218:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190208 00000100:00100000:3.0:1789050277.734318:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:3.0:1789050277.734333:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+25:15668:x1875954704190208:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789050277.734372:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050277.734403:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58bf5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fb5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734450:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734469:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734485:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734646:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58bf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 27 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734669:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 26 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.734679:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:3.0:1789050277.734683:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050277.734693:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae694800, rc 0) 00000100:00100000:3.0:1789050277.734787:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+26:15668:x1875954704190208:12345-192.168.203.42@tcp:101:dd.0 Request processed in 449us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050277.734795:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789050277.740582:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.740781:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190464 00000100:00100000:1.0:1789050277.740792:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190464 00000100:00100000:1.0:1789050277.740864:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:1.0:1789050277.740875:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+26:15668:x1875954704190464:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:2.0:1789050277.741097:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050277.741155:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.741175:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.741187:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050277.741231:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:1.0:1789050277.741254:0:20230:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000004098e773 reply state 00000000c88ba053 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.741266:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.741273:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050277.741275:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789050277.741279:0:20230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050277.741371:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704190464:12345-192.168.203.42@tcp:36:dd.0 Request processed in 498us (797us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789050277.741379:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000020:00080000:1.0:1789050277.741401:0:20230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050277.755106:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.755618:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190592 00000100:00100000:1.0:1789050277.755632:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190592 00000100:00100000:1.0:1789050277.755754:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:1.0:1789050277.755768:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704190592:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:1.0:1789050277.755805:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050277.755844:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58c0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fbc expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.762006:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58c0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fbc expref: 30 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.762042:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58c0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fbc expref: 30 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.762070:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050277.762075:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050277.762080:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042e00, rc 0) 00000100:00100000:1.0:1789050277.762653:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+30:15668:x1875954704190592:12345-192.168.203.42@tcp:101:dd.0 Request processed in 6882us (7557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050277.762664:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789050277.790722:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050277.790879:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190848 00000100:00100000:0.0:1789050277.790904:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190848 00000100:00100000:3.0:1789050277.791343:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:3.0:1789050277.791360:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+30:15668:x1875954704190848:12345-192.168.203.42@tcp:103:dd.0 00010000:00010000:3.0:1789050277.791381:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050277.791417:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58c0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fbc expref: 30 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.791443:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:3.0:1789050277.791449:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050277.791535:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704190848:12345-192.168.203.42@tcp:103:dd.0 Request processed in 180us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050277.791544:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:0.0:1789050277.809195:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050277.809455:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704190976 00000100:00100000:1.0:1789050277.809469:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704190976 00000100:00100000:1.0:1789050277.809552:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:1.0:1789050277.809564:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704190976:12345-192.168.203.42@tcp:58:dd.0 00010000:00010000:1.0:1789050277.809710:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.809755:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050277.809772:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050277.814392:0:20230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050277.814441:0:20230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789050277.814672:0:20230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789050277.814901:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaae70aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704190976:12345-192.168.203.42@tcp:58:dd.0 Request processed in 5320us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050277.814915:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:1.0:1789050277.825717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050277.826592:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704191104 00000100:00100000:3.0:1789050277.826608:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704191104 00000100:00100000:3.0:1789050277.826745:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:3.0:1789050277.826759:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+29:15668:x1875954704191104:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789050277.826788:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050277.826825:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fc3 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.826969:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.826984:0:17192:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 30 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.827025:0:17192:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.827043:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 30 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.827061:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:3.0:1789050277.827064:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050277.827068:0:17192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 30 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050277.827077:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baaae695200, rc 0) 00000100:00100000:3.0:1789050277.827174:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+30:15668:x1875954704191104:12345-192.168.203.42@tcp:101:dd.0 Request processed in 419us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050277.827182:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:1.0:1789050277.993687:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714746368:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.993804:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714746112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.993927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994009:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714746624:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994053:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994074:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714747136:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994097:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714747648:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994333:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789050277.994377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714746240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994406:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714746752:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994466:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714747264:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994499:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.994535:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746240 00000100:00100000:2.0:1789050277.994546:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746240 00000100:00100000:2.0:1789050277.994599:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746752 00000100:00100000:2.0:1789050277.994602:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746752 00000100:00100000:2.0:1789050277.994620:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789050277.994628:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714746240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994876:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875954714746240:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050277.994885:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789050277.994905:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789050277.994913:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714746752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.994980:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714746752:12345-0@lo:400:kworker.0 Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050277.994986:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789050277.995223:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875954714746240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995237:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714746752:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995295:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714746496:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995329:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.995352:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714747008:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995372:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.995387:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714747520:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050277.995450:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746624 00000100:00100000:2.0:1789050277.995455:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746624 00000100:00100000:2.0:1789050277.995480:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747136 00000100:00100000:2.0:1789050277.995484:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747136 00000100:00100000:2.0:1789050277.995496:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747648 00000100:00100000:2.0:1789050277.995498:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747648 00000100:00100000:2.0:1789050277.995528:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747264 00000100:00100000:2.0:1789050277.995532:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747264 00000100:00100000:2.0:1789050277.995546:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747520 00000100:00100000:2.0:1789050277.995549:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747520 00000100:00100000:2.0:1789050277.995566:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050277.995572:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714746624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995614:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875954714746624:12345-0@lo:400:kworker.0 Request processed in 42us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050277.995622:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050277.995648:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875954714746624:0@lo:400:kworker.0 00000100:00100000:2.0:1789050277.995666:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050277.995673:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714747136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050277.996045:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746112 00000100:00100000:0.0:1789050277.996052:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746112 00000100:00100000:0.0:1789050277.996100:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789050277.996110:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3646:x1875954714746112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050277.996173:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050277.996184:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714747648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.000457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050278.000540:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714746880:0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.000592:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050278.000612:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714747392:0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.000638:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050278.000831:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875954714747136:12345-0@lo:400:kworker.0 Request processed in 5156us (6730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.000844:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050278.000920:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875954714747136:0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.000977:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747392 00000100:00100000:2.0:1789050278.000985:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747392 00000100:00100000:2.0:1789050278.001347:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789050278.001360:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714747264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.001449:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875954714747264:12345-0@lo:400:kworker.0 Request processed in 93us (6949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.001455:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789050278.001483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875954714747264:0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.001503:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050278.001510:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714747520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.001546:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875954714747520:12345-0@lo:400:kworker.0 Request processed in 37us (6123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.001551:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050278.001577:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875954714747520:0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.001594:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050278.001601:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714747392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.001633:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875954714747392:12345-0@lo:400:kworker.0 Request processed in 34us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.001639:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050278.002389:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746496 00000100:00100000:2.0:1789050278.002402:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746496 00000100:00100000:2.0:1789050278.002458:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747008 00000100:00100000:2.0:1789050278.002462:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747008 00000100:00100000:2.0:1789050278.002478:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746368 00000100:00100000:2.0:1789050278.002481:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746368 00000100:00100000:2.0:1789050278.002494:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714746880 00000100:00100000:2.0:1789050278.002496:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714746880 00000100:00100000:2.0:1789050278.002511:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789050278.002519:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714746496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.002586:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714746496:12345-0@lo:400:kworker.0 Request processed in 67us (7256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.002606:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789050278.002622:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789050278.002628:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714747008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.002662:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714747008:12345-0@lo:400:kworker.0 Request processed in 34us (7288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.002668:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789050278.002679:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050278.002685:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714746368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.002904:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789050278.002916:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714746880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.003140:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875954714746880:12345-0@lo:400:kworker.0 Request processed in 227us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.003147:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789050278.003184:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050278.003190:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050278.003202:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050278.003206:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789050278.003246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875954714746880:0@lo:400:kworker.0 00010000:00080000:1.0:1789050278.003266:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab7f40a80 x1875954714747392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050278.003278:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875954714747392:0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.003384:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714746496:0@lo:400:kworker.0 00000100:00100000:1.0:1789050278.003398:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714747008:0@lo:400:kworker.0 00000100:00100000:0.0:1789050278.003550:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9e852cd-105e-4a2b-8f2f-088fc33df062+24:3646:x1875954714746112:12345-0@lo:400:kworker.0 Request processed in 7442us (9622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.003562:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789050278.003864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9e852cd-105e-4a2b-8f2f-088fc33df062:3646:1875954714746112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050278.004089:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875954714746368:12345-0@lo:400:kworker.0 Request processed in 1331us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.004098:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789050278.004561:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875954714746368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050278.009008:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875954714747648:12345-0@lo:400:kworker.0 Request processed in 12812us (14659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050278.009032:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789050278.011721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8baab7f40700 x1875954714747648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050278.011746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875954714747648:0@lo:400:kworker.0 00000040:00080000:2.0:1789050278.187144:0:17229:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050278.187158:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050278.187220:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789050278.187232:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789050278.187551:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17229:1875954714747776:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050278.187675:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d913c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050278.195115:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17229:1875954714747776:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050278.200031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.201190:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704191232 00000100:00100000:2.0:1789050278.201207:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704191232 00000100:00100000:2.0:1789050278.201314:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:2.0:1789050278.201326:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+30:15669:x1875954704191232:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789050278.201380:0:20230:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789050278.201546:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa85708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+30:15669:x1875954704191232:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 222us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.201575:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:1.0:1789050278.209753:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.209927:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704191360 00000100:00100000:0.0:1789050278.209979:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704191360 00000100:00100000:0.0:1789050278.210058:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789050278.210069:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+30:15669:x1875954704191360:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789050278.210187:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210209:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210224:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210242:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210251:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210257:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210295:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210304:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210311:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050278.210386:0:17194:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789050278.210391:0:17194:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789050278.210410:0:17194:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210422:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210435:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210442:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210448:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050278.210453:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210460:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210476:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:0.0:1789050278.210479:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050278.210485:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210491:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210507:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210513:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210519:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210525:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050278.210533:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210540:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210548:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ba9832fd500) 00010000:00010000:0.0:1789050278.210551:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050278.210554:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210561:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210578:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210585:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210591:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210596:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050278.210599:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210604:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210611:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050278.210613:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050278.210878:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.210888:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571c00/0x3b8ec5973df58c2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.211071:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+30:15669:x1875954704191360:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 1000us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.211081:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789050278.214709:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.214845:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704191616 00000100:00100000:2.0:1789050278.214859:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704191616 00000100:00100000:2.0:1789050278.214960:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:2.0:1789050278.214972:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+30:15669:x1875954704191616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.215000:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050278.215026:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df58c34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fca expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215166:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215188:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215204:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050278.215218:0:20230:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050278.215341:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215350:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215359:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215373:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.215378:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215407:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215423:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:2.0:1789050278.215427:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050278.215432:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215439:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215494:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df58c34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fca expref: 32 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215506:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baa9307b700) 00010000:00010000:2.0:1789050278.215509:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050278.215513:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031400/0x3b8ec5973df58c34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fca expref: 32 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.215524:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031400, rc 0) 00000100:00100000:2.0:1789050278.215612:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+31:15669:x1875954704191616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 641us (917us total) trans 8589934613 rc 301/301 00000100:00100000:2.0:1789050278.215620:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:2.0:1789050278.239741:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.239990:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704191744 00000100:00100000:0.0:1789050278.240004:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704191744 00000100:00100000:0.0:1789050278.240087:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789050278.240100:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+31:15669:x1875954704191744:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050278.240149:0:17194:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050278.240332:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+31:15669:x1875954704191744:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 234us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.240340:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789050278.247536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.251653:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192000 00000100:00100000:2.0:1789050278.251678:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192000 00000100:00100000:2.0:1789050278.251783:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050278.251796:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+31:15669:x1875954704192000:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.251859:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050278.251889:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fd1 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050278.252437:0:20230:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1789050278.252444:0:20230:0:(osp_object.c:1650:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789050278.252471:0:20230:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789050278.252653:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df58c50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.252672:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df58c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.252686:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df58c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.252759:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fd1 expref: 34 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.252784:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df58c50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fd1 expref: 33 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.252793:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800a00) 00010000:00010000:2.0:1789050278.252796:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050278.252801:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031200, rc 0) 00000100:00100000:2.0:1789050278.252903:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+33:15669:x1875954704192000:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1108us (5382us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789050278.252912:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789050278.267296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.267416:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192256 00000100:00100000:0.0:1789050278.267430:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192256 00000100:00100000:0.0:1789050278.267507:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789050278.267519:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+33:15669:x1875954704192256:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050278.267595:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050278.267629:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031200/0x3b8ec5973df58c50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fd1 expref: 33 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267655:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800a00) 00010000:00010000:0.0:1789050278.267677:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050278.267712:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267730:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267743:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267759:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267765:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267772:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267835:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267842:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267848:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267853:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983571a00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050278.267859:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267867:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267882:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:0.0:1789050278.267885:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050278.267889:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267895:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983571a00/0x3b8ec5973df58c5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267906:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267911:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267917:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267921:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba983570c00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:0.0:1789050278.267924:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.267930:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.268125:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xefdeb09b (ffff8ba9832fd500) 00010000:00010000:0.0:1789050278.268128:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050278.268131:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.268138:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba983570c00/0x3b8ec5973df58c65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefdeb09b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.268258:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+32:15669:x1875954704192256:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 740us (976us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050278.268267:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789050278.292254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.293418:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192384 00000100:00100000:2.0:1789050278.293436:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192384 00000100:00100000:2.0:1789050278.293530:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:2.0:1789050278.293542:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+32:15669:x1875954704192384:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.293572:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050278.293604:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fd8 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293653:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df58c73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293672:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df58c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293688:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df58c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293844:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030c00/0x3b8ec5973df58c6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fd8 expref: 34 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293870:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031000/0x3b8ec5973df58c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fd8 expref: 33 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.293880:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:2.0:1789050278.293883:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050278.293887:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80031000, rc 0) 00000100:00100000:2.0:1789050278.294032:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+33:15669:x1875954704192384:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 492us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.294039:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:1.0:1789050278.304894:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.305059:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192640 00000100:00100000:3.0:1789050278.305073:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192640 00000100:00100000:3.0:1789050278.305151:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:3.0:1789050278.305165:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+33:15669:x1875954704192640:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050278.305280:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.305326:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.305342:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050278.305575:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789050278.305588:0:17192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500503649920ns, next at 501503646257ns, rc = 0 00000004:00010000:3.0:1789050278.305670:0:17192:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000004e45ad41 reply state 0000000008c831ca transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.305687:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.305696:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:3.0:1789050278.305700:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789050278.305705:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050278.305854:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+35:15669:x1875954704192640:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 690us (974us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789050278.305864:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:0.0:1789050278.311918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.312114:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192768 00000100:00100000:1.0:1789050278.312128:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192768 00000100:00100000:1.0:1789050278.312205:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789050278.312219:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+35:15669:x1875954704192768:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050278.312255:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050278.312689:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fdf expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.312776:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 36 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.312794:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 36 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.312857:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:1.0:1789050278.312862:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050278.312867:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042c00, rc 0) 00000100:00100000:1.0:1789050278.312990:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+36:15669:x1875954704192768:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 774us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.312998:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789050278.321529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.321740:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704192896 00000100:00100000:1.0:1789050278.321753:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704192896 00000100:00100000:1.0:1789050278.321864:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789050278.321877:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baa84a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:2404:x1875954704192896:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789050278.322300:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baa84a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+6:2404:x1875954704192896:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 423us (784us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789050278.322309:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00080000:2.0:1789050278.322558:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050278.334389:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.334541:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704193152 00000100:00100000:2.0:1789050278.334557:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704193152 00000100:00100000:2.0:1789050278.334642:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789050278.334655:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+36:15669:x1875954704193152:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789050278.335017:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+37:15669:x1875954704193152:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 363us (642us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789050278.335026:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789050278.340869:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.343838:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704193408 00000100:00100000:3.0:1789050278.343860:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704193408 00000100:00100000:3.0:1789050278.344009:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789050278.344021:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+37:15669:x1875954704193408:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050278.344183:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+37:15669:x1875954704193408:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 162us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050278.344191:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:0.0:1789050278.349504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.349621:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704193536 00000100:00100000:2.0:1789050278.349635:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704193536 00000100:00100000:2.0:1789050278.349718:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:2.0:1789050278.349732:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+37:15669:x1875954704193536:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.349762:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050278.349791:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58c88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fe6 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.349904:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.349924:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.349984:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050278.350274:0:20230:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789050278.350749:0:20230:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.350831:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031c00/0x3b8ec5973df58c88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fe6 expref: 39 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.350857:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fe6 expref: 38 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.350868:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:2.0:1789050278.350872:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789050278.350876:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baa80030800, rc 0) 00000100:00100000:2.0:1789050278.351027:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+38:15669:x1875954704193536:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1295us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050278.351039:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:1.0:1789050278.369207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.369820:0:19123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704193664 00000100:00100000:0.0:1789050278.369837:0:19123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704193664 00000100:00100000:0.0:1789050278.369926:0:19123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789050278.369988:0:19123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:401f46b2-7a10-4bef-9b8f-516c59334602+6:2403:x1875954704193664:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050278.370015:0:19123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050278.370044:0:19123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966fed expref: -99 pid: 19123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050278.370075:0:19123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fbbf9c7d46c0, blocks: 0x0 00010000:00010000:0.0:1789050278.370099:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1789050278.370105:0:19123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050278.370116:0:19123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 7 pid: 19123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.370139:0:19123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 7 pid: 19123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.370182:0:19123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba983570e00, rc 0) 00000100:00100000:0.0:1789050278.370258:0:19123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:401f46b2-7a10-4bef-9b8f-516c59334602+7:2403:x1875954704193664:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 322us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.370267:0:19123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789050278.374606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.374725:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704193920 00000100:00100000:3.0:1789050278.374758:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704193920 00000100:00100000:3.0:1789050278.374840:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:3.0:1789050278.374854:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+38:15669:x1875954704193920:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050278.375050:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+38:15669:x1875954704193920:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 199us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050278.375058:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:2.0:1789050278.389994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.399101:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194048 00000100:00100000:1.0:1789050278.399121:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194048 00000100:00100000:1.0:1789050278.399223:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789050278.399570:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+38:15669:x1875954704194048:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789050278.414020:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000004:00080000:0.0:1789050278.414049:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789050278.414100:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789050278.415657:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415682:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415693:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415719:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050278.415725:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415735:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415760:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:1.0:1789050278.415764:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789050278.415769:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.415777:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58b23 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.416089:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+19:15669:x1875954704194048:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 16849us (26156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.416099:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789050278.420297:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714747904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789050278.420409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050278.421219:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714747904 00000100:00100000:3.0:1789050278.421244:0:18698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714747904 00000100:00100000:3.0:1789050278.421332:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050278.421346:0:18698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875954714747904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789050278.421539:0:18698:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789050278.421543:0:18698:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789050278.421546:0:18698:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789050278.421549:0:18698:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789050277379000000 -> 1789050277379000000 00002000:00010000:3.0:1789050278.421552:0:18698:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789050278.421635:0:18698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875954714747904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 292us (1226us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789050278.421643:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:3.0:1789050278.421707:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8baab7f44e00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789050278.421715:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875954714747904:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789050278.423507:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423530:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423540:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423546:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.423552:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423561:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423609:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba983288300) 00010000:00010000:2.0:1789050278.423614:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050278.423620:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423628:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58acf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423659:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423665:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423672:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423678:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa829d7e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.423681:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423688:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423696:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba9832fd200) 00010000:00010000:2.0:1789050278.423698:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050278.423701:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423706:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa829d7e00/0x3b8ec5973df58ad6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423733:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423740:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423745:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423750:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.423752:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423757:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423764:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8baa88800c00) 00010000:00010000:2.0:1789050278.423766:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050278.423769:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423774:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031e00/0x3b8ec5973df58b7e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423790:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423795:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423800:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423822:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.423825:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423831:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423839:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:2.0:1789050278.423841:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050278.423845:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423850:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58c03 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423863:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423870:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423876:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423880:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:2.0:1789050278.423883:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423889:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423906:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:2.0:1789050278.423908:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789050278.423911:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.423917:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c7a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.447184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.449272:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194176 00000100:00100000:1.0:1789050278.449305:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194176 00000100:00100000:1.0:1789050278.449388:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:1.0:1789050278.449402:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:401f46b2-7a10-4bef-9b8f-516c59334602+7:2403:x1875954704194176:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789050278.450297:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:401f46b2-7a10-4bef-9b8f-516c59334602+7:2403:x1875954704194176:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 882us (3113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.450311:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789050278.467584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.467744:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194432 00000100:00100000:3.0:1789050278.467758:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194432 00000100:00100000:3.0:1789050278.467846:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:3.0:1789050278.467860:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+15:15669:x1875954704194432:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050278.467972:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050278.468008:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80030800/0x3b8ec5973df58c8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fe6 expref: 15 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.468051:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:3.0:1789050278.468059:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050278.468100:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.468119:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.468130:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050278.468434:0:17192:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000097b380bb reply state 00000000597f2c1b transno 8589934617 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.468450:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695600/0x3b8ec5973df58c9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.468457:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:3.0:1789050278.468460:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789050278.468463:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050278.468594:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:401f46b2-7a10-4bef-9b8f-516c59334602+16:15669:x1875954704194432:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 737us (1025us total) trans 8589934617 rc 0/0 00000100:00100000:3.0:1789050278.468603:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:3.0:1789050278.471694:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.472420:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194560 00000100:00100000:1.0:1789050278.472431:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194560 00000100:00100000:1.0:1789050278.472489:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789050278.472499:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+7:15669:x1875954704194560:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050278.472516:0:19575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050278.472533:0:19575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ff4 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.472566:0:19575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 8 pid: 19123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.472577:0:19575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050278.472581:0:19575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050278.472587:0:19575:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 8 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.472632:0:19575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 8 pid: 19123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.472653:0:19575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 8 pid: 19123 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.472668:0:19575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19575:1875954714748032:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050278.472760:0:19575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789050278.478599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.478973:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194688 00000100:00100000:3.0:1789050278.478987:0:17178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194688 00010000:00010000:3.0:1789050278.479045:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 9 pid: 19123 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050278.479121:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789050278.479131:0:17178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:401f46b2-7a10-4bef-9b8f-516c59334602+9:2404:x1875954704194688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050278.479147:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050278.479170:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 9 pid: 19123 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.479183:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 9 pid: 19123 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.479214:0:17178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050278.479219:0:17178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050278.479225:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.479234:0:17178:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.479277:0:17178:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050278.479290:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17178:1875954714748160:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789050278.479381:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baa82c8dc00 going to sleep for 11 seconds 00010000:00010000:1.0:1789050278.481904:0:19575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c0c89c/0x3b8ec5973df58c96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fed expref: 9 pid: 19123 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.482010:0:19575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19575:1875954714748032:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050278.482046:0:19575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 8 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.482064:0:19575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2043000, rc 0) 00000100:00100000:1.0:1789050278.482141:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+8:15669:x1875954704194560:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 9642us (10456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.482152:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789050278.490506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.490599:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17178:1875954714748160:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789050278.490605:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194816 00000100:00100000:1.0:1789050278.490616:0:18699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194816 00010000:00010000:3.0:1789050278.490646:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050278.490693:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789050278.490708:0:18699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+8:2404:x1875954704194816:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789050278.490967:0:17178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:401f46b2-7a10-4bef-9b8f-516c59334602+9:2404:x1875954704194688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 11800us (12349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050278.490980:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00002000:00010000:1.0:1789050278.491006:0:18699:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789050278.491012:0:18699:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789050276815000000 00002000:00010000:1.0:1789050278.491015:0:18699:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789050276106543703 00002000:00010000:1.0:1789050278.491018:0:18699:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789050277379000000 -> 1789050276815000000 00002000:00010000:1.0:1789050278.491021:0:18699:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789050278.491068:0:18699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:401f46b2-7a10-4bef-9b8f-516c59334602+8:2404:x1875954704194816:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 363us (577us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789050278.491075:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:2.0:1789050278.497350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.497463:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704194944 00000100:00100000:1.0:1789050278.497473:0:18700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704194944 00000100:00100000:2.0:1789050278.498454:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:2.0:1789050278.498466:0:18700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:401f46b2-7a10-4bef-9b8f-516c59334602+8:2404:x1875954704194944:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.498514:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.498538:0:18700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 8 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.498548:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050278.498553:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050278.498557:0:18700:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.498593:0:18700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 8 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.498609:0:18700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 8 pid: 19575 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050278.498641:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18700:1875954714748288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050278.498782:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050278.503103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.503167:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195072 00000100:00100000:0.0:1789050278.503177:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195072 00010000:00010000:0.0:1789050278.503216:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.503272:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789050278.503283:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+9:2403:x1875954704195072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050278.503297:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050278.503316:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.503329:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.503366:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050278.503370:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050278.503376:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503381:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e89f7bc/0x3b8ec5973df58ca4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ff4 expref: 9 pid: 19575 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.503390:0:17179:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050278.503405:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18700:1875954714748288:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789050278.503413:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050278.503428:0:18700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503441:0:18700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503450:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503472:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.503473:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+8:2403:x1875954704195072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 190us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.503489:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00010000:00010000:3.0:1789050278.503491:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503501:0:18700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503533:0:18700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80030600 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050278.503537:0:18700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503547:0:18700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503562:0:18700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.503569:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000613d6fd6/0x3b8ec5973df58cab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050278.503627:0:18700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:401f46b2-7a10-4bef-9b8f-516c59334602+7:2404:x1875954704194944:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 5162us (6285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050278.503636:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789050278.510280:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050278.510871:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195328 00000100:00100000:2.0:1789050278.510882:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195328 00000100:00100000:2.0:1789050278.511161:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:2.0:1789050278.511173:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+16:15669:x1875954704195328:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050278.511251:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.511269:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.511279:0:20230:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.511312:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.511327:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 16 pid: 17192 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050278.511341:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748416:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789050278.511430:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050278.520471:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.520636:0:20218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195456 00000100:00100000:0.0:1789050278.520644:0:20218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195456 00010000:00010000:0.0:1789050278.520683:0:20218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 17 pid: 17192 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.520766:0:20218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789050278.520776:0:20218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:401f46b2-7a10-4bef-9b8f-516c59334602+17:2404:x1875954704195456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050278.520790:0:20218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050278.520797:0:20218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 17 pid: 17192 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520817:0:20218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 17 pid: 17192 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520847:0:20218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:0.0:1789050278.520854:0:20218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520864:0:20218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520872:0:20218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520879:0:20218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.520896:0:20218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050278.520995:0:20218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:401f46b2-7a10-4bef-9b8f-516c59334602+17:2404:x1875954704195456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 220us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.521002:0:20218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00010000:00010000:1.0:1789050278.521084:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae694800/0x3b8ec5973df58bfc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fb5 expref: 16 pid: 17192 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.521112:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba98227c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748416:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050278.521130:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521140:0:20230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521146:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521335:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521347:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521355:0:20230:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521380:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.521394:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 16 pid: 17193 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.521406:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748544:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789050278.521467:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789050278.528197:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748544:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789050278.528226:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050278.529930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050278.530142:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195584 00000100:00100000:0.0:1789050278.530152:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195584 00010000:00010000:0.0:1789050278.530191:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 17 pid: 17193 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.530232:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789050278.530241:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+17:2403:x1875954704195584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050278.530255:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050278.530262:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 17 pid: 17193 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530294:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 17 pid: 17193 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530316:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042c00/0x3b8ec5973df58c81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fdf expref: 17 pid: 17193 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530333:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:0.0:1789050278.530338:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530348:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530356:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.530384:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050278.530432:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba98227c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:401f46b2-7a10-4bef-9b8f-516c59334602+16:2403:x1875954704195584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 192us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.530440:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00010000:00010000:2.0:1789050278.530546:0:20230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.530555:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050278.530667:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:2.0:1789050278.530771:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000001:00080000:2.0:1789050278.530802:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1789050278.530885:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20230:1875954714748672:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050278.531180:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050278.531210:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baaa7d91180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050278.531253:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714748672 00000100:00100000:0.0:1789050278.531259:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714748672 00000100:00100000:0.0:1789050278.531296:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789050278.531303:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20230:x1875954714748672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050278.531385:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20230:x1875954714748672:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050278.531392:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050278.531491:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20230:1875954714748672:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789050278.531623:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:1.0:1789050278.531662:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20230:1875954714748800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789050278.531689:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050278.531711:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050278.531756:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714748800 00000100:00100000:2.0:1789050278.531761:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714748800 00000100:00100000:2.0:1789050278.531789:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789050278.531795:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20230:x1875954714748800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050278.531909:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20230:x1875954714748800:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (219us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789050278.531917:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789050278.532013:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20230:1875954714748800:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789050278.532038:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532047:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532054:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532060:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2042e00 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050278.532065:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532073:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532086:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:1.0:1789050278.532089:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050278.532093:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532106:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042e00/0x3b8ec5973df58cb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532135:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532142:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532148:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532153:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050278.532157:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532162:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532170:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050278.532172:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050278.532178:0:20230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532189:0:20230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532198:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.532254:0:20230:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8baaae695200/0x3b8ec5973df58c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966fc3 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.532265:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748928:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789050278.532325:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baab11b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050278.534492:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20230:1875954714748928:192.168.203.42@tcp:105: 00010000:00010000:1.0:1789050278.534517:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534528:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043600/0x3b8ec5973df58c11 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534558:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534571:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534587:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534598:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534604:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534610:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534633:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043000 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050278.534637:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534644:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534655:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050278.534658:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050278.534662:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534668:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043000/0x3b8ec5973df58cc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534678:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534684:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534690:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534695:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baa80031600 already unused, calling callback (ffffffffc18984f0) 00010000:00010000:1.0:1789050278.534698:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534704:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534720:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050278.534722:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050278.534725:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.534732:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baa80031600/0x3b8ec5973df58cb2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050278.534921:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:401f46b2-7a10-4bef-9b8f-516c59334602+19:15669:x1875954704195328:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 23750us (24650us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789050278.534931:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000020:00080000:1.0:1789050278.534958:0:20230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789050278.535195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.535336:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195712 00000100:00100000:1.0:1789050278.535344:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195712 00000100:00100000:1.0:1789050278.535389:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789050278.535398:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baaaea22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+19:15668:x1875954704195712:12345-192.168.203.42@tcp:49:dd.0 00000100:00100000:1.0:1789050278.535488:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baaaea22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+19:15668:x1875954704195712:12345-192.168.203.42@tcp:49:dd.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.535494:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000040:00080000:2.0:1789050278.535864:0:17229:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050278.535869:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050278.535904:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789050278.535911:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789050278.536727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.536787:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704195968 00000100:00100000:1.0:1789050278.536794:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704195968 00000100:00100000:1.0:1789050278.536840:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789050278.536849:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+19:15669:x1875954704195968:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789050278.537200:0:17195:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789050278.537233:0:17195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934623 00010000:00010000:1.0:1789050278.537267:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537290:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537302:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537311:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537318:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537325:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.537381:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789050278.537454:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:401f46b2-7a10-4bef-9b8f-516c59334602+21:15669:x1875954704195968:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 606us (731us total) trans 8589934624 rc 0/0 00000100:00100000:1.0:1789050278.537462:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000020:00080000:1.0:1789050278.537466:0:17195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789050278.538135:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050278.538143:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.538151:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043e00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:3.0:1789050278.538155:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.538164:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.538186:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baa88800400) 00010000:00010000:3.0:1789050278.538189:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789050278.538194:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.538200:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043e00/0x3b8ec5973df58cc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.538214:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050278.538216:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050278.538218:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050278.538272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.538344:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196096 00000100:00100000:1.0:1789050278.538351:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196096 00000100:00100000:1.0:1789050278.538419:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789050278.538428:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+21:15668:x1875954704196096:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:1.0:1789050278.538441:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050278.538454:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58cce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13a683cad3966ffb expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538480:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58cd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538497:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538506:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538594:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2043400/0x3b8ec5973df58cce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ffb expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538610:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8baac2042800/0x3b8ec5973df58cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x13a683cad3966ffb expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.538617:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8baa88800600) 00010000:00010000:1.0:1789050278.538620:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050278.538623:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8baac2042800, rc 0) 00000100:00100000:1.0:1789050278.538692:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:401f46b2-7a10-4bef-9b8f-516c59334602+22:15668:x1875954704196096:12345-192.168.203.42@tcp:101:dd.0 Request processed in 265us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050278.538699:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:2.0:1789050278.684383:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789050278.684502:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196224 00000100:00100000:1.0:1789050278.684512:0:18704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196224 00000100:00100000:1.0:1789050278.684584:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789050278.684596:0:18704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:401f46b2-7a10-4bef-9b8f-516c59334602+7:2406:x1875954704196224:12345-192.168.203.42@tcp:4:dd.0 00002000:00010000:1.0:1789050278.684642:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x18d3fbbf7adf51c0, atime: 0x18d3fbbf50a52257, ctime: 0x18d3fbbf7adf51c0, blocks: 0x0 00010000:00010000:1.0:1789050278.684652:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.684667:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1789050278.684678:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050278.684685:0:18704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050278.684699:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.685266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050278.685380:0:18706:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789050278.685390:0:18706:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789050278.687515:0:18705:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789050278.687540:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196352 00000100:00100000:2.0:1789050278.687549:0:18705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196352 00000100:00100000:3.0:1789050278.692315:0:20333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:3.0:1789050278.692336:0:20333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:401f46b2-7a10-4bef-9b8f-516c59334602+8:2405:x1875954704196352:12345-192.168.203.42@tcp:4:dd.0 00010000:00010000:3.0:1789050278.692380:0:20333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.692398:0:20333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050278.692402:0:20333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050278.692408:0:20333:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.692424:0:20333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050278.761202:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789050278.845089:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1789050278.845106:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1789050278.845284:0:18704:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789050278.845289:0:18704:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789050276815000000 -> 1789050277746589126 00002000:00010000:2.0:1789050278.845302:0:18704:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789050276815000000 -> 1789050277746589126 00002000:00010000:2.0:1789050278.845304:0:18704:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789050278.845321:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845334:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845344:0:18704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845352:0:18704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baac2043400 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:2.0:1789050278.845357:0:18704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845368:0:18704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845390:0:18704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050278.845398:0:18704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032fed865/0x3b8ec5973df58cdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050278.845510:0:18704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:401f46b2-7a10-4bef-9b8f-516c59334602+7:2406:x1875954704196224:12345-192.168.203.42@tcp:4:dd.0 Request processed in 160913us (161132us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789050278.845520:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000001:00080000:2.0:1789050278.868625:0:19512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789050278.869062:0:20333:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789050278.869067:0:20333:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789050278.869083:0:20333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869095:0:20333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869104:0:20333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869111:0:20333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8baaae695c00 already unused, calling callback (ffffffffc0c838f0) 00010000:00010000:0.0:1789050278.869116:0:20333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869125:0:20333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869143:0:20333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050278.869151:0:20333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc59bcb4/0x3b8ec5973df58ce3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050278.869271:0:20333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196352:12345-192.168.203.42@tcp:4:dd.0 Request processed in 176939us (184003us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789050278.869287:0:20333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00010000:00010000:2.0:1789050279.787519:0:18345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050280.042610:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050280.042633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050280.042701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050280.042998:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749056 00000100:00100000:3.0:1789050280.043023:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749056 00000100:00100000:3.0:1789050280.043080:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789050280.043090:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050280.043121:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789050280.043169:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050280.043176:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789050280.043238:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789050280.043244:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8baab7f44e00, transno 8589934596 00000004:00080000:3.0:1789050280.043254:0:3645:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789050280.043279:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789050280.043466:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050280.044893:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050280.044977:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050280.045134:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749184 00000100:00100000:1.0:1789050280.045144:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749184 00000100:00100000:1.0:1789050280.045349:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050280.045360:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050280.045385:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789050280.045428:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050280.045435:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789050280.046462:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050280.046526:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050280.048511:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714749312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789050280.048580:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050280.048868:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749312 00000100:00100000:3.0:1789050280.048877:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749312 00000100:00100000:3.0:1789050280.049162:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789050280.049174:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714749312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789050280.049209:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00080000:2.0:1789050280.049298:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050280.049708:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714749312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 536us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050280.049717:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050280.049870:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714749312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789050280.395915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789050280.395999:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196608 00000100:00100000:0.0:1789050280.396018:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196608 00000100:00100000:2.0:1789050280.396027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050280.396070:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050280.396239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:3.0:1789050280.396247:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050280.396269:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196864 00000100:00100000:3.0:1789050280.396275:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196864 00000100:00100000:2.0:1789050280.396288:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789050280.396330:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050280.396340:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704197376 00000100:00100000:3.0:1789050280.396418:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704197376 00000100:00100000:3.0:1789050280.396461:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789050280.396471:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196864:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050280.396550:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196864:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050280.396558:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789050280.396575:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:3.0:1789050280.396582:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197376:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050280.396625:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197376:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050280.396631:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00080000:3.0:1789050280.396751:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050280.403046:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704197120 00000100:00100000:0.0:1789050280.403061:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704197120 00000100:00100000:0.0:1789050280.403136:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196736 00000100:00100000:0.0:1789050280.403140:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196736 00000100:00100000:0.0:1789050280.403162:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:0.0:1789050280.403172:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+22:2405:x1875954704196608:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050280.403256:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+22:2405:x1875954704196608:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 85us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050280.403263:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:0.0:1789050280.403280:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:0.0:1789050280.403287:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+6:2405:x1875954704197120:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050280.403313:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+6:2405:x1875954704197120:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050280.403319:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:0.0:1789050280.403330:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:0.0:1789050280.403336:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196736:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050280.403356:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196736:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 20us (7030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050280.403426:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00080000:0.0:1789050280.403647:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789050280.403652:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050280.404082:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196480 00000100:00100000:0.0:1789050280.404089:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196480 00000100:00100000:0.0:1789050280.404123:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:0.0:1789050280.404130:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2405:x1875954704196480:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050280.404172:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba983c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fdf6249-ae65-4ba9-86f7-1bba4403ff26+13:2405:x1875954704196480:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 42us (7889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050280.404179:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:3.0:1789050280.409261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050280.409316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050280.409358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789050280.409394:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704196992 00000100:00100000:3.0:1789050280.409403:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704196992 00000100:00100000:3.0:1789050280.409459:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704197504 00000100:00100000:3.0:1789050280.409463:0:19575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704197504 00000100:00100000:3.0:1789050280.409489:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:3.0:1789050280.409501:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196992:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050280.409574:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:401f46b2-7a10-4bef-9b8f-516c59334602+5:2405:x1875954704196992:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050280.409582:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:3.0:1789050280.409603:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789050280.409626:0:19575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197504:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789050280.409654:0:19575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197504:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00080000:0.0:1789050280.410173:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050280.410646:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704197248 00000100:00100000:0.0:1789050280.410657:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704197248 00000100:00100000:0.0:1789050280.410730:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:0.0:1789050280.410747:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197248:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789050280.410852:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecbb0205-dfd3-498a-b75f-85e633519280+5:2405:x1875954704197248:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 110us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050280.410862:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00080000:0.0:1789050280.410889:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789050280.411181:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00000001:02000400:3.0:1789050280.576524:0:20370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789050280.809454:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050281.065915:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050281.065955:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714749440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789050281.066028:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050281.066348:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749440 00000100:00100000:3.0:1789050281.066358:0:18702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749440 00000100:00100000:3.0:1789050281.066433:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789050281.066443:0:18702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714749440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789050281.066465:0:18702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789050281.066524:0:18702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875954714749440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050281.066530:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050281.066607:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875954714749440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789050281.066663:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050281.578858:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050281.578881:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8baab7f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714749568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050281.578965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050281.579016:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749568 00000100:00100000:3.0:1789050281.579023:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749568 00000100:00100000:3.0:1789050281.579066:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789050281.579074:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714749568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789050281.579106:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789050281.579147:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875954714749568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050281.579154:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789050281.579200:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8baab7f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875954714749568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789050281.582919:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ba983f5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789050281.583009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050281.583102:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954714749696 00000100:00100000:0.0:1789050281.583110:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954714749696 00000100:00100000:0.0:1789050281.583161:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789050281.583170:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8baab7f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789050281.583203:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789050281.588461:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8baab7f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875954714749696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5279us (5439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050281.588478:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050281.589198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ba983f5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875954714749696:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789050281.641136:0:17229:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789050281.641147:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050281.641167:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789050281.641183:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789050281.834236:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41852 lines, 41852 kept, 0 dropped, 0 bad.